Apr 20 17:36:35 user devstack@n-api.service[61865]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 17:36:35 user devstack@n-api.service[61865]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 17:36:35 2023] *** Apr 20 17:36:35 user devstack@n-api.service[61865]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 17:36:35 user devstack@n-api.service[61865]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 17:36:35 user devstack@n-api.service[61865]: nodename: user Apr 20 17:36:35 user devstack@n-api.service[61865]: machine: x86_64 Apr 20 17:36:35 user devstack@n-api.service[61865]: clock source: unix Apr 20 17:36:35 user devstack@n-api.service[61865]: pcre jit disabled Apr 20 17:36:35 user devstack@n-api.service[61865]: detected number of CPU cores: 12 Apr 20 17:36:35 user devstack@n-api.service[61865]: current working directory: / Apr 20 17:36:35 user devstack@n-api.service[61865]: detected binary path: /usr/bin/uwsgi-core Apr 20 17:36:35 user devstack@n-api.service[61865]: your processes number limit is 63637 Apr 20 17:36:35 user devstack@n-api.service[61865]: your memory page size is 4096 bytes Apr 20 17:36:35 user devstack@n-api.service[61865]: detected max file descriptor number: 2048 Apr 20 17:36:35 user devstack@n-api.service[61865]: lock engine: pthread robust mutexes Apr 20 17:36:35 user devstack@n-api.service[61865]: thunder lock: enabled Apr 20 17:36:35 user devstack@n-api.service[61865]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 17:36:35 user devstack@n-api.service[61865]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 17:36:35 user devstack@n-api.service[61865]: Python main interpreter initialized at 0x55c878aae990 Apr 20 17:36:35 user devstack@n-api.service[61865]: python threads support enabled Apr 20 17:36:35 user devstack@n-api.service[61865]: your server socket listen backlog is limited to 100 connections Apr 20 17:36:35 user devstack@n-api.service[61865]: your mercy for graceful operations on workers is 90 seconds Apr 20 17:36:35 user devstack@n-api.service[61865]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 17:36:35 user devstack@n-api.service[61865]: *** Operational MODE: preforking *** Apr 20 17:36:35 user devstack@n-api.service[61865]: *** uWSGI is running in multiple interpreter mode *** Apr 20 17:36:35 user devstack@n-api.service[61865]: spawned uWSGI master process (pid: 61865) Apr 20 17:36:35 user devstack@n-api.service[61865]: spawned uWSGI worker 1 (pid: 61866, cores: 1) Apr 20 17:36:35 user devstack@n-api.service[61865]: spawned uWSGI worker 2 (pid: 61867, cores: 1) Apr 20 17:36:35 user devstack@n-api.service[61865]: spawned uWSGI worker 3 (pid: 61868, cores: 1) Apr 20 17:36:35 user devstack@n-api.service[61865]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 17:36:36 user devstack@n-api.service[61867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 17:36:36 user devstack@n-api.service[61868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 17:36:36 user devstack@n-api.service[61866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 17:36:39 user devstack@n-api.service[61868]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 17:36:39 user devstack@n-api.service[61868]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 17:36:39 user devstack@n-api.service[61868]: and ``live_migration_inbound_addr`` respectively. Apr 20 17:36:39 user devstack@n-api.service[61868]: ). Its value may be silently ignored in the future. Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 17:36:39 user devstack@n-api.service[61867]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 17:36:39 user devstack@n-api.service[61867]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 17:36:39 user devstack@n-api.service[61867]: and ``live_migration_inbound_addr`` respectively. Apr 20 17:36:39 user devstack@n-api.service[61867]: ). Its value may be silently ignored in the future. Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61868) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 17:36:39 user devstack@n-api.service[61866]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 17:36:39 user devstack@n-api.service[61866]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 17:36:39 user devstack@n-api.service[61866]: and ``live_migration_inbound_addr`` respectively. Apr 20 17:36:39 user devstack@n-api.service[61866]: ). Its value may be silently ignored in the future. Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61867) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: INFO dbcounter [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Registered counter for database nova_api Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_db.sqlalchemy.engines [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61868) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writer thread running {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 17:36:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61866) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 17:36:39 user devstack@n-api.service[61867]: INFO dbcounter [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Registered counter for database nova_api Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_db.sqlalchemy.engines [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61867) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writer thread running {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG nova.context [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f878406-f865-4f02-bb10-aa57d0aa28b3(cell1) {{(pid=61868) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:39 user devstack@n-api.service[61868]: INFO dbcounter [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Registered counter for database nova_cell0 Apr 20 17:36:39 user devstack@n-api.service[61868]: INFO dbcounter [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Registered counter for database nova_cell1 Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_db.sqlalchemy.engines [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61868) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writer thread running {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:39 user devstack@n-api.service[61868]: DEBUG oslo_db.sqlalchemy.engines [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61868) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:39 user devstack@n-api.service[61866]: INFO dbcounter [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Registered counter for database nova_api Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG nova.context [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f878406-f865-4f02-bb10-aa57d0aa28b3(cell1) {{(pid=61867) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:39 user devstack@n-api.service[61867]: INFO dbcounter [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Registered counter for database nova_cell0 Apr 20 17:36:39 user devstack@n-api.service[61867]: INFO dbcounter [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Registered counter for database nova_cell1 Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG oslo_db.sqlalchemy.engines [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61867) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writer thread running {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG oslo_db.sqlalchemy.engines [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61867) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61866) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writer thread running {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writer thread running {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61868]: INFO dbcounter [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Registered counter for database nova_cell0 Apr 20 17:36:40 user devstack@n-api.service[61868]: DEBUG oslo_db.sqlalchemy.engines [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61868) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writer thread running {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG nova.context [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f878406-f865-4f02-bb10-aa57d0aa28b3(cell1) {{(pid=61866) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:36:40 user devstack@n-api.service[61866]: INFO dbcounter [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Registered counter for database nova_cell0 Apr 20 17:36:40 user devstack@n-api.service[61866]: INFO dbcounter [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Registered counter for database nova_cell1 Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61866) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writer thread running {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writer thread running {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61866) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61867]: INFO dbcounter [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Registered counter for database nova_cell0 Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG oslo_db.sqlalchemy.engines [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61867) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writer thread running {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writer thread running {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61866]: INFO dbcounter [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Registered counter for database nova_cell0 Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61866) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 17:36:40 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writer thread running {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 17:36:40 user devstack@n-api.service[61868]: WARNING keystonemiddleware.auth_token [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61868]: WARNING keystonemiddleware.auth_token [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:40 user devstack@n-api.service[61867]: WARNING keystonemiddleware.auth_token [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61867]: WARNING keystonemiddleware.auth_token [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:40 user devstack@n-api.service[61868]: WARNING keystonemiddleware.auth_token [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61868]: WARNING keystonemiddleware.auth_token [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:40 user devstack@n-api.service[61868]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c878aae990 pid: 61868 (default app) Apr 20 17:36:40 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:36:40 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 20 17:36:40 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 17:36:40 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:36:40 user devstack@n-api.service[61866]: WARNING keystonemiddleware.auth_token [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61866]: WARNING keystonemiddleware.auth_token [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:40 user devstack@n-api.service[61867]: WARNING keystonemiddleware.auth_token [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61867]: WARNING keystonemiddleware.auth_token [None req-698a9caa-3343-40ef-affc-3a2f42a75397 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:40 user devstack@n-api.service[61867]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c878aae990 pid: 61867 (default app) Apr 20 17:36:40 user devstack@n-api.service[61866]: WARNING keystonemiddleware.auth_token [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 17:36:40 user devstack@n-api.service[61866]: WARNING keystonemiddleware.auth_token [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 17:36:41 user devstack@n-api.service[61866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c878aae990 pid: 61866 (default app) Apr 20 17:38:49 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:49 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-37f3bab0-9da4-4419-9038-29264691b2b6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002245 Apr 20 17:38:49 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:38:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:38:49 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:49 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:49 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:49 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:49 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ff6a0160-56ca-465c-92fe-cb9e2beaf4ad admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:49 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ff6a0160-56ca-465c-92fe-cb9e2beaf4ad admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.376889 Apr 20 17:38:49 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 17:38:49 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:38:51 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:51 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002427 Apr 20 17:38:51 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:38:51 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:38:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:38:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8783b5d7-2266-470b-9efb-558205b14cdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "ram": 256}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8783b5d7-2266-470b-9efb-558205b14cdd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.372795 Apr 20 17:38:52 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:38:51 2023] POST /compute/v2.1/flavors => generated 405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:38:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ad9e8813-b910-464b-9d22-66e98dbfac79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ad9e8813-b910-464b-9d22-66e98dbfac79 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050973 Apr 20 17:38:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 17:38:52 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:38:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001347 Apr 20 17:38:54 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:38:54 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:38:54 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6502d3cd-7bc4-4983-92d3-a6096a49378a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 5, "name": "ds512M"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:54 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-6502d3cd-7bc4-4983-92d3-a6096a49378a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069250 Apr 20 17:38:54 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:38:54 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:38:54 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-e4a55d0f-daf9-4457-9cb1-5ad6c084b405 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-e4a55d0f-daf9-4457-9cb1-5ad6c084b405 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046936 Apr 20 17:38:54 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 17:38:54 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:38:56 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:56 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001329 Apr 20 17:38:56 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:38:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:38:56 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-2ccc4069-8903-40a6-93b9-916077b1e893 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-2ccc4069-8903-40a6-93b9-916077b1e893 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070616 Apr 20 17:38:56 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:38:56 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:38:56 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d5e53c1b-7da3-4c67-a24b-07b1f78893c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:56 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d5e53c1b-7da3-4c67-a24b-07b1f78893c7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025791 Apr 20 17:38:56 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 17:38:56 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:38:58 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:38:58 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 20 17:38:58 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:38:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:38:58 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-dab4092d-bd64-4f17-8f2e-65126719be14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "swap": 0}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:58 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-dab4092d-bd64-4f17-8f2e-65126719be14 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065265 Apr 20 17:38:58 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:38:58 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:38:58 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-65372b79-3be5-4591-8ab0-11f91d4b875b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:38:58 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-65372b79-3be5-4591-8ab0-11f91d4b875b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040433 Apr 20 17:38:58 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 17:38:58 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:00 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:00 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001308 Apr 20 17:39:00 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:00 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-36e94707-b185-4613-82be-9eadf9c0bfd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:00 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-36e94707-b185-4613-82be-9eadf9c0bfd2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063974 Apr 20 17:39:00 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:00 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:39:00 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:00 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023980 Apr 20 17:39:00 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 17:39:00 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:02 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:02 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e9aa45d-2490-4077-a515-d57c902c167d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001748 Apr 20 17:39:02 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:02 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:02 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-016bf920-6215-4d73-8ad3-74dee1e2f8ca admin admin] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:02 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-016bf920-6215-4d73-8ad3-74dee1e2f8ca admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069804 Apr 20 17:39:02 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 17:39:02 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:39:04 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:04 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001410 Apr 20 17:39:04 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:39:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:39:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:39:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:39:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a5bfb502-bf1e-40e5-ab86-acf04178a0ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "swap": 0}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:04 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a5bfb502-bf1e-40e5-ab86-acf04178a0ce admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.309631 Apr 20 17:39:04 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:04 2023] POST /compute/v2.1/flavors => generated 400 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:39:04 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-854d3c5f-0671-491e-922e-98c22918f96b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:04 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-854d3c5f-0671-491e-922e-98c22918f96b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036776 Apr 20 17:39:04 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 17:39:04 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:06 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:06 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Apr 20 17:39:06 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:06 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5af58b9e-e23a-4655-9406-b90d8e3888fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:06 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5af58b9e-e23a-4655-9406-b90d8e3888fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059923 Apr 20 17:39:06 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:06 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:39:06 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8efb6648-2e11-4dac-bda9-bb0814a966c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:06 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8efb6648-2e11-4dac-bda9-bb0814a966c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030283 Apr 20 17:39:06 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 17:39:06 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:08 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:08 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001312 Apr 20 17:39:08 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:08 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-42fea51e-23ca-4626-b514-338e5173a6de admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:08 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-42fea51e-23ca-4626-b514-338e5173a6de admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061392 Apr 20 17:39:08 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:08 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:39:08 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-067f3ea3-3891-4c2b-aa53-3d67d053241c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:08 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-067f3ea3-3891-4c2b-aa53-3d67d053241c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025189 Apr 20 17:39:08 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 17:39:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:10 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:10 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Apr 20 17:39:10 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:10 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e7521568-a6a5-4e31-89a7-206904d15b97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e7521568-a6a5-4e31-89a7-206904d15b97 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.103152 Apr 20 17:39:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 17:39:10 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-e3bdadc4-1bc6-426a-a3f2-65713f01d1c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:10 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-e3bdadc4-1bc6-426a-a3f2-65713f01d1c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029341 Apr 20 17:39:10 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 17:39:10 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:12 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:12 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001374 Apr 20 17:39:12 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 17:39:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:12 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bd5d1b5d-c4a0-41cd-b17e-06e90873cdcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:12 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bd5d1b5d-c4a0-41cd-b17e-06e90873cdcd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060421 Apr 20 17:39:12 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 17:39:12 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:39:12 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-34a5e813-a744-4aed-9584-560635c993a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:39:12 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-34a5e813-a744-4aed-9584-560635c993a2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023468 Apr 20 17:39:12 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 17:39:12 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:39:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bc7cd8f8-8272-493b-838d-d4c331b1550c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001372 Apr 20 17:39:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 17:39:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:39:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:39:43 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.096767 Apr 20 17:39:43 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 17:39:43 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:40:15 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-34a5e813-a744-4aed-9584-560635c993a2 admin admin] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:40:15 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-34a5e813-a744-4aed-9584-560635c993a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001650 Apr 20 17:40:15 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 17:40:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:40:15 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:40:15 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-31dac3b8-7d02-4238-9bac-d00d185e8e46 admin admin] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:40:15 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-31dac3b8-7d02-4238-9bac-d00d185e8e46 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.070504 Apr 20 17:40:15 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 17:40:15 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:40:19 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:40:19 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002200 Apr 20 17:40:19 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 17:40:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:40:19 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:40:19 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-74536653-9d8a-46b4-9a63-51f109379d89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.nano", "os-flavor-access:is_public": true, "disk": 1, "id": "42", "rxtx_factor": 1.0}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:40:19 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-74536653-9d8a-46b4-9a63-51f109379d89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068136 Apr 20 17:40:19 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 17:40:19 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:40:19 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-11b396a4-2579-46df-ad76-2d50bbd99d53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:40:19 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-11b396a4-2579-46df-ad76-2d50bbd99d53 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034730 Apr 20 17:40:19 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 17:40:19 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:40:23 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:40:23 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bc770129-9128-4d41-ad8d-56bf1f401aea admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001557 Apr 20 17:40:23 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 17:40:23 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:40:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8b845b97-0951-480d-9122-957f72e5bb70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 192, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "vcpus": 1, "name": "m1.micro"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:40:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8b845b97-0951-480d-9122-957f72e5bb70 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066035 Apr 20 17:40:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 17:40:23 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:40:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-29d3c5ac-ac82-4602-80c1-7eeba5b2ea4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:40:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-29d3c5ac-ac82-4602-80c1-7eeba5b2ea4e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024116 Apr 20 17:40:24 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 17:40:24 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:42:35 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:42:35 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:42:35 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:42:35 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a3deb764-8cb6-4b1d-97bc-3d8c5aedf164 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Action: 'create', calling method: .version_select at 0x7f342e5537f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1380013998", "metadata": {"Type": "work"}}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:36 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a3deb764-8cb6-4b1d-97bc-3d8c5aedf164 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.652463 Apr 20 17:42:36 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 17:42:35 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1654 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 17:42:36 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:42:36 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-387d7b08-145e-48d0-9a8c-64e2cff412f3 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Calling method '.version_select at 0x7f342e483520>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:36 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-387d7b08-145e-48d0-9a8c-64e2cff412f3 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5" status: 200 len: 350 microversion: 2.1 time: 0.198242 Apr 20 17:42:36 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:42:36 2023] GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5 => generated 350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:42:37 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:42:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d2a858ac-c330-4e9f-94be-45ae20cbe23d tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Calling method '.version_select at 0x7f342e457010>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:38 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d2a858ac-c330-4e9f-94be-45ae20cbe23d tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5" status: 200 len: 350 microversion: 2.1 time: 0.355074 Apr 20 17:42:38 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:42:37 2023] GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5 => generated 350 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:42:38 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-0e908b38-271f-4b65-a7fb-0bd6c38e9c00 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Calling method '.version_select at 0x7f342e309000>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:38 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-0e908b38-271f-4b65-a7fb-0bd6c38e9c00 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5" status: 202 len: 0 microversion: 2.1 time: 0.427697 Apr 20 17:42:38 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:42:38 2023] DELETE /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 17:42:38 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-17a3d5c0-9025-4c9b-a9b9-22ab49ac0715 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Calling method '.version_select at 0x7f342e3037f0>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-17a3d5c0-9025-4c9b-a9b9-22ab49ac0715 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] HTTP exception thrown: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. Apr 20 17:42:38 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-17a3d5c0-9025-4c9b-a9b9-22ab49ac0715 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Request method failure captured: Apr 20 17:42:38 user devstack@n-api.service[61868]: request: GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5 HTTP/1.1 Apr 20 17:42:38 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:42:38 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:42:38 user devstack@n-api.service[61868]: Connection: close Apr 20 17:42:38 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:42:38 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:42:38 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:42:38 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:42:38 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmL1SKLpSEe7Cgdvycz7Pr_iYhvBGci8SbzEubHaq3HM_l_0f9M4IucdC_mGSbzhn5RXXsa8InIFl-KlDY11MjQrjWNmkS7RMycychqF6_etEZ_2wnw0dVSdnBap-rYu_dHHsKVGOfwlgEeGjFjYKQMZ2gKtT42-wd-tiY9QBuIEQ4 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Project-Id: f2c50fb50e3f4e5e98f1fcecc4f12429 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Project-Name: tempest-VolumesGetTestJSON-1978746087 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f2c50fb50e3f4e5e98f1fcecc4f12429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f2c50fb50e3f4e5e98f1fcecc4f12429"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f2c50fb50e3f4e5e98f1fcecc4f12429"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Tenant: tempest-VolumesGetTestJSON-1978746087 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Tenant-Id: f2c50fb50e3f4e5e98f1fcecc4f12429 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-VolumesGetTestJSON-1978746087 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-User: tempest-VolumesGetTestJSON-1978746087-project-member Apr 20 17:42:38 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:42:38 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:42:38 user devstack@n-api.service[61868]: X-User-Id: 838f627d2c4c473b870eb6a72f734dc4 Apr 20 17:42:38 user devstack@n-api.service[61868]: X-User-Name: tempest-VolumesGetTestJSON-1978746087-project-member Apr 20 17:42:38 user devstack@n-api.service[61868]: method: Apr 20 17:42:38 user devstack@n-api.service[61868]: exception: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. Apr 20 17:42:38 user devstack@n-api.service[61868]: action_args: {'id': '4f103652-b694-49c5-8f27-40a6882e39f5'} Apr 20 17:42:38 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. (HTTP 404) (Request-ID: req-6b3ca559-cd24-4fe1-b308-2af127d7dad6) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. Apr 20 17:42:38 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:42:38 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-17a3d5c0-9025-4c9b-a9b9-22ab49ac0715 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] Returning 404 to user: Volume 4f103652-b694-49c5-8f27-40a6882e39f5 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:42:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-17a3d5c0-9025-4c9b-a9b9-22ab49ac0715 tempest-VolumesGetTestJSON-1978746087 tempest-VolumesGetTestJSON-1978746087-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5" status: 404 len: 109 microversion: 2.1 time: 0.062238 Apr 20 17:42:38 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:42:38 2023] GET /compute/v2.1/os-volumes/4f103652-b694-49c5-8f27-40a6882e39f5 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:42:50 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-e10f2d85-e410-4569-ad39-012d2c81d821 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Action: 'create', calling method: .version_select at 0x7f342e4f6ef0>, body: {"keypair": {"name": "tempest-keypair-1126183261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtZpk0CCYx0yfYyJJteYG7oPkqc/xE72hF9qjLdB8gQsnWpcMP/JzYDHEWevmVJOylvHB1J6THx2x8KcdSZJOvpMaAAvnJ2dEZ4W2eieW4kmgy4qQL6KyBKhm7575m/1Q=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:50 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-e10f2d85-e410-4569-ad39-012d2c81d821 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for project d829829f4ef449d4a279c8a702d4c43f. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:42:50 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-e10f2d85-e410-4569-ad39-012d2c81d821 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for user 7b1d025cf0584fa286870d8232bceb97 and project d829829f4ef449d4a279c8a702d4c43f. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:42:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-e10f2d85-e410-4569-ad39-012d2c81d821 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310346 Apr 20 17:42:50 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:42:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:42:50 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1365257638", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "433927b9-c258-4fc3-8c36-ea03b670b240"}]}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:50 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] validate_networks() for [('433927b9-c258-4fc3-8c36-ea03b670b240', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:42:50 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-506954582", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "cbba4d5f-f68a-4ca3-96ec-3aad4b0cc331"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:51 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] validate_networks() for [('cbba4d5f-f68a-4ca3-96ec-3aad4b0cc331', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Getting quotas for project f3e097e2307a48ada61048d11f4dfdb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Getting quotas for user 0e87e05c599c44b3af17a42d3df1fc14 and project f3e097e2307a48ada61048d11f4dfdb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:42:52 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:42:52 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-436dcdef-ba19-46aa-a6ee-81b2cf95eae6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.641380 Apr 20 17:42:52 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:42:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:42:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-16bcf1ba-6e72-4dac-8425-f79284a9e7e0 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:52 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-16bcf1ba-6e72-4dac-8425-f79284a9e7e0 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:42:52 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-16bcf1ba-6e72-4dac-8425-f79284a9e7e0 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:42:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-16bcf1ba-6e72-4dac-8425-f79284a9e7e0 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1211 microversion: 2.1 time: 0.170125 Apr 20 17:42:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:42:52 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Getting quotas for project 89d97029a59944b6a9653c7d7d26d008. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Getting quotas for user c944a1a40e30441097ea5022becccd81 and project 89d97029a59944b6a9653c7d7d26d008. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:42:53 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:42:54 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-2fb76891-d7e8-4988-b895-7525baa8878f tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.338537 Apr 20 17:42:54 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 19/54] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:42:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:42:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-f9dfa063-1e66-4e66-9ecb-e1bd3c39c71b tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:54 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-f9dfa063-1e66-4e66-9ecb-e1bd3c39c71b tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:42:54 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-f9dfa063-1e66-4e66-9ecb-e1bd3c39c71b tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c944a1a40e30441097ea5022becccd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d97029a59944b6a9653c7d7d26d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:42:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-f9dfa063-1e66-4e66-9ecb-e1bd3c39c71b tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb" status: 200 len: 1208 microversion: 2.1 time: 0.242122 Apr 20 17:42:54 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:42:54 2023] GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb => generated 1208 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:42:56 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-300041286", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a8d6d208-ea97-4ed8-9275-a5b494bca17f"}], "security_groups": [{"name": "tempest-securitygroup--1866142638"}], "key_name": "tempest-keypair-1126183261", "user_data": "}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:56 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] validate_networks() for [('a8d6d208-ea97-4ed8-9275-a5b494bca17f', None, None, None, None, None)] {{(pid=61867) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Flavor limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Image limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Flavor pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Image pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for project d829829f4ef449d4a279c8a702d4c43f. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for user 7b1d025cf0584fa286870d8232bceb97 and project d829829f4ef449d4a279c8a702d4c43f. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Going to run 1 instances... {{(pid=61867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:42:58 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:42:58 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-cf1922a2-8773-4eae-b772-305d2cdba969 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.825966 Apr 20 17:42:58 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:42:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 2828 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:42:58 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-10de20bd-90bd-4920-8f40-338c64643605 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:42:58 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-10de20bd-90bd-4920-8f40-338c64643605 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:42:59 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-10de20bd-90bd-4920-8f40-338c64643605 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:42:59 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-10de20bd-90bd-4920-8f40-338c64643605 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 200 len: 1231 microversion: 2.1 time: 0.180382 Apr 20 17:42:59 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 20/57] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:42:58 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 1231 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:42:59 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-32479ed5-a40c-4298-a317-38c34ea7d9d0 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Action: 'create', calling method: .version_select at 0x7f342e3f9480>, body: {"keypair": {"name": "tempest-keypair-367701788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl1iRKW33baFcnF5BJ8AgusAleEE6ZBJSZkvfOgLOuPRfAN1yrBRtPVUTrVARGX+GjbSJ7WI5e2M1kCqQoYcrmOHH2MOTwRCPjt9XYNfZqeQv6xHN5i9Vea8nppoi4w9Q=="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:42:59 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-32479ed5-a40c-4298-a317-38c34ea7d9d0 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Getting quotas for project 2d8b7e93a856468e831596fbf4a085bc. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:42:59 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-32479ed5-a40c-4298-a317-38c34ea7d9d0 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Getting quotas for user f3c1ddc4186b4234a18271673ea42a2a and project 2d8b7e93a856468e831596fbf4a085bc. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:42:59 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-32479ed5-a40c-4298-a317-38c34ea7d9d0 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.504365 Apr 20 17:42:59 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:42:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Creating event network-changed:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61867) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d5dde52d-f6d8-4371-85b1-24268b292dc1 req-fd11deaa-3625-4241-b63f-79631144d640 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61867) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:01 user devstack@n-api.service[61867]: INFO nova.compute.rpcapi [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 17:43:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61867) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 17:43:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-3584950d-8e39-4820-aabb-94d878b2ffd1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229599 Apr 20 17:43:01 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Creating event network-changed:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61868) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9d85d62d-6fe7-4401-802d-54aade0be0e9 req-d85fea2e-74fb-46a0-8a8e-271ccd810240 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61868) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:03 user devstack@n-api.service[61868]: INFO nova.compute.rpcapi [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 17:43:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] Releasing lock "compute-rpcapi-router" {{(pid=61868) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 17:43:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-d5060ab7-1742-4af8-b667-7e6ebd54dbcf None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092773 Apr 20 17:43:03 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 21/60] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1200723010", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "20843b57-f0c3-4bd6-b46f-5180300d24b2"}], "security_groups": [{"name": "tempest-securitygroup--932732054"}], "key_name": "tempest-keypair-367701788", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] validate_networks() for [('20843b57-f0c3-4bd6-b46f-5180300d24b2', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:43:05 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:05 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:05 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:05 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:05 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] Creating event network-changed:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:43:05 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-fb0a845c-8fa1-4e79-a16c-cb3fa4315275 req-1eb8e186-361b-404e-9f30-8b526122eea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091407 Apr 20 17:43:05 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:06 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Getting quotas for project 2d8b7e93a856468e831596fbf4a085bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:06 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Getting quotas for user f3c1ddc4186b4234a18271673ea42a2a and project 2d8b7e93a856468e831596fbf4a085bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:06 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:43:06 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:43:06 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a329d6b2-ae6a-4f2c-ab24-601351c676c2 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.172640 Apr 20 17:43:06 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 20/62] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:43:04 2023] POST /compute/v2.1/servers => generated 403 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:43:06 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-3b987306-fbba-4746-8a86-40a067e86b25 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:06 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-3b987306-fbba-4746-8a86-40a067e86b25 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:06 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-3b987306-fbba-4746-8a86-40a067e86b25 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c1ddc4186b4234a18271673ea42a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b7e93a856468e831596fbf4a085bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:06 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-3b987306-fbba-4746-8a86-40a067e86b25 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 200 len: 1239 microversion: 2.1 time: 0.147412 Apr 20 17:43:06 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 22/63] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:06 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 1239 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:08 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "name": "network-vif-plugged", "status": "completed", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:08 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] Creating event network-vif-plugged:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:43:08 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-af24d3f5-3d2f-49e9-9ca7-2495ad952a89 req-26b290cf-0546-41ef-bc2a-0f1ba098be76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044537 Apr 20 17:43:08 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "name": "network-vif-plugged", "status": "completed", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Creating event network-vif-plugged:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:43:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:43:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61866) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-fb1f35f0-b46c-445c-ab85-1a05a694739a req-67dbf14d-0c14-4f03-a0e6-8bc4e8d9247d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61866) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:10 user devstack@n-api.service[61866]: INFO nova.compute.rpcapi [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 17:43:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] Releasing lock "compute-rpcapi-router" {{(pid=61866) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 17:43:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-ba906e35-474b-462c-9064-209c21ec2597 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.209642 Apr 20 17:43:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:11 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:11 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:11 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:11 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:11 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] Creating event network-changed:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:43:11 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-1a43dda6-3a0b-4353-b353-82598153a321 req-23d271bb-9fe2-448b-a926-9abb339eb52a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072203 Apr 20 17:43:11 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 23/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:12 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=12 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:12 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:12 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-4c294843-f753-4480-8321-1b265d3a3b20 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Action: 'create', calling method: .version_select at 0x7f342e3cd510>, body: {"keypair": {"name": "tempest-keypair-2051272814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl83HyxTx4CnmrVsDm92QIgX9r3ZS3IlLQGdfjELWl2vqGxl3c4ySZKDsgAFKHtPRQVDBYVtQjNa+moytiGD1GjAwLMcebMVi+i2icW9hW2w92P3F9ICY4zREG1TlC98w=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:12 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-4c294843-f753-4480-8321-1b265d3a3b20 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Getting quotas for project d30dfddf52a146b2861fbe504571ce4e. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:12 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-4c294843-f753-4480-8321-1b265d3a3b20 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Getting quotas for user 7efd93562be24b6e8cd642cbd44b003f and project d30dfddf52a146b2861fbe504571ce4e. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:12 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-4c294843-f753-4480-8321-1b265d3a3b20 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.278865 Apr 20 17:43:12 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:43:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:12 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "name": "network-vif-plugged", "status": "completed", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}, {"server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "name": "network-vif-plugged", "status": "completed", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:12 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Creating event network-vif-plugged:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:43:12 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] Creating event network-vif-plugged:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:43:12 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-53cad252-ac6c-48de-9946-4711a62df2c4 req-a26842c3-c96d-452f-960e-baf6148e6984 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066926 Apr 20 17:43:12 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:14 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:14 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-620d89d6-89fd-47b6-8a70-1c6065031059 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Action: 'create', calling method: .version_select at 0x7f342e2cd000>, body: {"keypair": {"name": "tempest-keypair-794500022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4IcmYZR9OYOtebAMwlK/U5E2DuTgKD2My0f7Fshy1aphepmzAEOAqMOypNWSU349A2Ew+mLaCWG/XaLoI4cTTZusOITb8pl3FMAGNHaU/Wq85vZgNPTsiekqaGOarPCA=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:14 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-620d89d6-89fd-47b6-8a70-1c6065031059 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:14 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-620d89d6-89fd-47b6-8a70-1c6065031059 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for user 3bbaba13b37342668437a13b9eb0939b and project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:14 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-620d89d6-89fd-47b6-8a70-1c6065031059 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.539753 Apr 20 17:43:14 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:43:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:43:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "name": "network-vif-plugged", "status": "completed", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] Creating event network-vif-plugged:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:43:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-b8f54b63-be7a-428e-8d15-e5a2994f251c req-37cd2cb6-80ee-4f02-bd37-7e344d3a8cd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132889 Apr 20 17:43:16 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:16 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=18 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:16 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-516638328", "imageRef": "85b65f6a-f9fd-4a19-9063-7d56394c21b3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "9e1d3f28-093f-4151-9414-14a8650a5f4f"}], "security_groups": [{"name": "tempest-securitygroup--1516849498"}], "key_name": "tempest-keypair-2051272814", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:17 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] validate_networks() for [('9e1d3f28-093f-4151-9414-14a8650a5f4f', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:43:18 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "name": "network-vif-plugged", "status": "completed", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:18 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:18 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:18 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:18 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] Creating event network-vif-plugged:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:43:18 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-1fd5bc85-686e-450f-a37c-f5c77a3089b9 req-f7237ed8-53fd-4c8f-92ce-001c3a652dbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082936 Apr 20 17:43:18 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:43:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:43:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:43:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:43:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Getting quotas for project d30dfddf52a146b2861fbe504571ce4e. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Getting quotas for user 7efd93562be24b6e8cd642cbd44b003f and project d30dfddf52a146b2861fbe504571ce4e. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:43:19 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85b65f6a-f9fd-4a19-9063-7d56394c21b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:43:19 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e5da4d0-b5b2-4cbd-bb61-8a09f4155906 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.393275 Apr 20 17:43:19 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 23/72] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:43:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 2395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 20 17:43:19 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-50223204-cbc2-4c3d-b36c-858f63c17af2 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:19 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-50223204-cbc2-4c3d-b36c-858f63c17af2 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:19 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-50223204-cbc2-4c3d-b36c-858f63c17af2 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efd93562be24b6e8cd642cbd44b003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30dfddf52a146b2861fbe504571ce4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:19 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-50223204-cbc2-4c3d-b36c-858f63c17af2 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 200 len: 1239 microversion: 2.1 time: 0.143234 Apr 20 17:43:19 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 25/73] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:19 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 1239 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:21 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-532528466", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "dcd79c16-699b-47bf-a62f-a1ff679ca5f8"}], "security_groups": [{"name": "tempest-securitygroup--361001146"}], "key_name": "tempest-keypair-794500022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:21 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:22 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] validate_networks() for [('dcd79c16-699b-47bf-a62f-a1ff679ca5f8', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:43:23 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:43:23 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:43:23 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:43:23 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:43:23 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=15 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=11 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for user 3bbaba13b37342668437a13b9eb0939b and project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:43:24 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:43:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-46ed5b08-8cab-4e7e-b805-82da2d86bf6e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.366346 Apr 20 17:43:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:43:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:43:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-df459da6-81d5-43ea-baff-0b8064c390ce tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:24 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-df459da6-81d5-43ea-baff-0b8064c390ce tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:24 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=10 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:24 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-df459da6-81d5-43ea-baff-0b8064c390ce tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-df459da6-81d5-43ea-baff-0b8064c390ce tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20" status: 200 len: 1234 microversion: 2.1 time: 0.122709 Apr 20 17:43:24 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 24/75] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:24 2023] GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 => generated 1234 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:25 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=13 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:25 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] Creating event network-changed:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:43:25 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-7e992341-83d3-480a-87a0-ffae8d317093 req-5a4e7734-1639-435e-b358-f836a1721e26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072795 Apr 20 17:43:25 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:28 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] Creating event network-changed:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:43:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-8f7dda68-cf8b-45b8-8a70-6951268e3988 req-ab01bff5-f650-48dd-bdb3-62c072798360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079314 Apr 20 17:43:28 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "name": "network-vif-plugged", "status": "completed", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=10 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:29 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] Creating event network-vif-plugged:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:43:29 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-0e22ed42-a687-4da5-bc28-0926272a6cc6 req-87526ebf-fdf0-4d25-89dd-2dcaec851c0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062711 Apr 20 17:43:29 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 25/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:31 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "name": "network-vif-plugged", "status": "completed", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] Creating event network-vif-plugged:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:43:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-2453dcbc-a8fa-435f-aba2-0eeac2f72001 req-9b5a4ab8-7145-4a48-8e33-69724d43e8c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056801 Apr 20 17:43:31 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "name": "network-vif-plugged", "status": "completed", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] Creating event network-vif-plugged:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:43:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-c688885b-42ee-46db-92a9-946e24df0b35 req-5ad61fb4-e204-4b96-bf3d-b7e142a32bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076067 Apr 20 17:43:32 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:34 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=8 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:34 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "name": "network-vif-plugged", "status": "completed", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:34 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] Creating event network-vif-plugged:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:43:34 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-49b0179b-8b84-4066-9196-510e9760cf94 req-a0693485-09bb-4ca9-b45f-3d0e24593638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039744 Apr 20 17:43:34 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-3817df3c-1e7a-41e8-8856-cc9ffbe66218 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] Action: 'create', calling method: .version_select at 0x7f342e3cd510>, body: {"keypair": {"name": "tempest-TestShelveInstance-28205356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMSdv4CMVZIR4p06R74K7aCA1EYFTyIJDy/PPBLji3px3QzTDjNYNe+D+I66YYGEzEtIMGNWaWuKSBHztYwD+fnTNt1LUdf9swruZI6bhCcYQpozPb3Wo61E9Til+R3iQ=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:37 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-3817df3c-1e7a-41e8-8856-cc9ffbe66218 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] Getting quotas for project 6d550a79177640e7b0f56567b58b9d74. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:37 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-3817df3c-1e7a-41e8-8856-cc9ffbe66218 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] Getting quotas for user 364839d193fd44b4a5ffd97b6f4370cb and project 6d550a79177640e7b0f56567b58b9d74. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:37 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-3817df3c-1e7a-41e8-8856-cc9ffbe66218 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.388785 Apr 20 17:43:37 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 28/82] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:43:37 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=5 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=5 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:43 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:43 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-bc948827-b894-4254-aa80-ecd0c5bd70f5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1494 microversion: 2.1 time: 0.446989 Apr 20 17:43:43 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 29/83] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:42 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1494 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:43 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-82241d4f-8df5-4d2b-a091-b58da6882d87 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] Calling method '.version_select at 0x7f342da468c0>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:43 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-82241d4f-8df5-4d2b-a091-b58da6882d87 tempest-TestShelveInstance-1074098751 tempest-TestShelveInstance-1074098751-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28205356" status: 202 len: 0 microversion: 2.1 time: 0.048257 Apr 20 17:43:43 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:43:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28205356 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:45 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c944a1a40e30441097ea5022becccd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d97029a59944b6a9653c7d7d26d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:45 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-dfaa627d-c91e-4026-8a50-ff7e511fe5d7 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb" status: 200 len: 1489 microversion: 2.1 time: 0.936689 Apr 20 17:43:45 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:44 2023] GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb => generated 1489 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:46 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-42a40223-f21f-4593-85cb-23a5197dc58a tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] Action: 'create', calling method: .version_select at 0x7f342d961360>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-970253512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATYIZRv8aEIbZXLaaN65vz9NvmR25S4pnia55ZfS4wKwbb3Guqp5l0GxReUpjYdZBFkjQTgRetKQPSGqP+3kxyHMpdC6P1NSV1Z5UUJb1SM00PYww2GB6EqQsr6Eqb/kg=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:46 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-42a40223-f21f-4593-85cb-23a5197dc58a tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] Getting quotas for project d3b7cf76c52b47a3b1bd5cb49ee3ba38. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:46 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-42a40223-f21f-4593-85cb-23a5197dc58a tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] Getting quotas for user be473dbcdf224e7692b88d83ede6b6c1 and project d3b7cf76c52b47a3b1bd5cb49ee3ba38. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:46 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-42a40223-f21f-4593-85cb-23a5197dc58a tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.061966 Apr 20 17:43:46 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:43:46 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:49 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-7cc083bd-5bf4-4c6b-a355-a77d0d12e9e3 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 200 len: 1538 microversion: 2.1 time: 0.406253 Apr 20 17:43:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 28/87] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:49 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 1538 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:51 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:51 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-06c78578-984b-47ff-924e-cbfb8e307cad tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: .version_select at 0x7f342e27ab00>, body: {"keypair": {"name": "tempest-keypair-19367170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnSwFZi2Pvu/+7GzYDP2c6Iz2HoDftyx5bJc9lhf5lUyb104o/2xpFEfyDOtlmE/EkF02E+dGA6fmPqIFyxAroMUQnscpnUQnuwofLzC5xiWRWb/XmG5oEaNS8uIIiAA=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:51 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-06c78578-984b-47ff-924e-cbfb8e307cad tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:51 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-06c78578-984b-47ff-924e-cbfb8e307cad tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:51 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-06c78578-984b-47ff-924e-cbfb8e307cad tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.293857 Apr 20 17:43:51 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 30/88] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:43:51 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:43:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-2b283c1a-a257-429e-8051-5000c7ed2077 tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] Calling method '.version_select at 0x7f342d962680>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-2b283c1a-a257-429e-8051-5000c7ed2077 tempest-TestVolumeBootPattern-1417536691 tempest-TestVolumeBootPattern-1417536691-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-970253512" status: 202 len: 0 microversion: 2.1 time: 0.052987 Apr 20 17:43:52 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 20 17:43:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-970253512 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:43:55 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-781860856", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "81717015-dd1b-405e-b3be-87c2e48c6e76"}], "security_groups": [{"name": "tempest-securitygroup--1605500306"}], "key_name": "tempest-keypair-19367170", "user_data": "}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:43:55 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:55 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] validate_networks() for [('81717015-dd1b-405e-b3be-87c2e48c6e76', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:43:56 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:43:56 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a26a866a-fb95-4a4f-a134-33eba00527cf tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.954090 Apr 20 17:43:56 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 29/90] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:43:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:43:56 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:56 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-7c96f797-a5fb-4c01-9bf1-6997b0a14ea3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:56 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-7c96f797-a5fb-4c01-9bf1-6997b0a14ea3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:56 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:56 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-7c96f797-a5fb-4c01-9bf1-6997b0a14ea3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:56 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-7c96f797-a5fb-4c01-9bf1-6997b0a14ea3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 200 len: 1233 microversion: 2.1 time: 0.081627 Apr 20 17:43:56 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 31/91] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:56 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 1233 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c1ddc4186b4234a18271673ea42a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b7e93a856468e831596fbf4a085bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:43:56 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:43:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-805a378e-2503-479d-8329-ebec246b02b7 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 200 len: 1551 microversion: 2.1 time: 0.409520 Apr 20 17:43:56 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:43:56 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 1551 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:01 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:01 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] Creating event network-changed:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:44:01 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-21c62755-4e7b-466d-a6fc-0bc571588a04 req-33efae5c-4a54-4ff1-bd4a-c45387a7fd0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051395 Apr 20 17:44:01 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:02 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-578a08f5-0423-4a47-b755-f37456ecc669 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Action: 'create', calling method: .version_select at 0x7f342d900f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-640193228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsbJbB/jWDXWeVCmOF+Ekcfn7NZGrazfjen3KP5tU08yxfcXKQIqAv5mrGXwLl1BoINaP2k+jEAFWB0kCh9cjg2b5KK657GMvEP7J2fXm7aIi20p4BhJHXYJmr4FwHNKg=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:02 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-578a08f5-0423-4a47-b755-f37456ecc669 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:44:02 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-578a08f5-0423-4a47-b755-f37456ecc669 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for user bfeb17aa1177414ea2f2a8dc310670b4 and project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:44:02 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-578a08f5-0423-4a47-b755-f37456ecc669 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064315 Apr 20 17:44:02 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 32/94] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:44:02 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:02 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1989717275", "imageRef": "120e869d-7391-48fe-ac59-4f9c95761027", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-640193228", "networks": [{"uuid": "4569ce3e-4c90-488e-b4f7-feb6c08602aa"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:02 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] validate_networks() for [('4569ce3e-4c90-488e-b4f7-feb6c08602aa', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for user bfeb17aa1177414ea2f2a8dc310670b4 and project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:44:03 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='120e869d-7391-48fe-ac59-4f9c95761027',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:44:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-cab65747-2f66-4c9d-90c2-aac810d23b97 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.735260 Apr 20 17:44:03 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 33/95] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:44:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:44:03 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-57bba663-860e-45c4-9228-e8da9388e2d0 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:03 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-57bba663-860e-45c4-9228-e8da9388e2d0 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:03 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-57bba663-860e-45c4-9228-e8da9388e2d0 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-57bba663-860e-45c4-9228-e8da9388e2d0 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 200 len: 1252 microversion: 2.1 time: 0.082056 Apr 20 17:44:03 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 31/96] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:03 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:04 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "name": "network-vif-plugged", "status": "completed", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:04 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] Creating event network-vif-plugged:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:44:04 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-50173126-210f-46a5-99c3-560e8e0856d9 req-70048e02-2e28-4f9a-a7d0-88ed1978b5ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051775 Apr 20 17:44:04 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:06 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:06 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:06 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:06 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:06 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] Creating event network-changed:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:44:06 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-149e097c-ebdc-4736-abac-44409a36734c req-b295062c-5214-496c-9b11-c65f810a6d5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049084 Apr 20 17:44:06 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:06 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "name": "network-vif-plugged", "status": "completed", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:06 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:06 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:06 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:06 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:06 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] Creating event network-vif-plugged:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:44:06 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-51ed766f-3430-4adb-825d-09a34feb5bab req-ca4d245e-5aba-4a63-b835-f2286928752d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041085 Apr 20 17:44:06 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 32/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:08 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "name": "network-vif-plugged", "status": "completed", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:08 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:08 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] Creating event network-vif-plugged:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:44:08 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-87c5c136-b490-461d-9a5e-837b2d8a7d8a req-a1dc73df-3aed-4ab2-b9c2-eb327f2b6680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043833 Apr 20 17:44:08 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:09 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efd93562be24b6e8cd642cbd44b003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30dfddf52a146b2861fbe504571ce4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:09 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-b1b889ae-aa74-4edd-be85-84550e42e75d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 200 len: 1549 microversion: 2.1 time: 0.379752 Apr 20 17:44:09 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 35/101] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:09 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 1549 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:10 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "name": "network-vif-plugged", "status": "completed", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] Creating event network-vif-plugged:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:44:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-16c83daa-7ddd-43d4-b632-cd5b919c7c55 req-711ce5ec-74c2-4abf-9edb-6f22bf452043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076647 Apr 20 17:44:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 33/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=10 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:14 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:14 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-b4712e75-4a41-4da2-9f7b-352d42355d61 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20" status: 200 len: 1543 microversion: 2.1 time: 0.236222 Apr 20 17:44:14 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:14 2023] GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 => generated 1543 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:18 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:18 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:19 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-3b4c09db-3194-4e52-8722-d49f58657a35 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Action: 'create', calling method: .version_select at 0x7f342d961a20>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-27470692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCPr3Y4gu9c4R1DDias//1yTcF6ps5j4tm2WQDtctJUCnK/NMi6EfPmzhVDdmln14Ls8QLsOh1ph3eRRGBNTOquA0PTd1qVLrGa1gm8JxSGPu6aLTJQN3HUUbt3d1XOqQ=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:19 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:19 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-3b4c09db-3194-4e52-8722-d49f58657a35 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Getting quotas for project bbeddd6447ba44fcba3cd2dfbde3b2f5. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:44:19 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-3b4c09db-3194-4e52-8722-d49f58657a35 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Getting quotas for user 2f3ad335897b487ba1b386d785ba8fd3 and project bbeddd6447ba44fcba3cd2dfbde3b2f5. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:44:19 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-3b4c09db-3194-4e52-8722-d49f58657a35 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.261638 Apr 20 17:44:19 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:44:18 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:20 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=8 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:20 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:20 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=14 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:20 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-401968799", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-27470692", "security_groups": [{"name": "tempest-secgroup-smoke-998928754"}], "networks": [{"uuid": "1f37d708-3a28-47f0-8be7-4bd489486bda"}]}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:20 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] validate_networks() for [('1f37d708-3a28-47f0-8be7-4bd489486bda', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Getting quotas for project bbeddd6447ba44fcba3cd2dfbde3b2f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Getting quotas for user 2f3ad335897b487ba1b386d785ba8fd3 and project bbeddd6447ba44fcba3cd2dfbde3b2f5. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:44:21 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:44:21 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-1d73c240-6575-46b3-a055-74450d5a3e29 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.701339 Apr 20 17:44:21 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 34/105] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:44:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:44:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-47b44671-832b-459b-afe8-4a74144bdd68 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:21 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-47b44671-832b-459b-afe8-4a74144bdd68 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:21 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-47b44671-832b-459b-afe8-4a74144bdd68 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3ad335897b487ba1b386d785ba8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbeddd6447ba44fcba3cd2dfbde3b2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-47b44671-832b-459b-afe8-4a74144bdd68 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 200 len: 1254 microversion: 2.1 time: 0.067355 Apr 20 17:44:21 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:21 2023] GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 1254 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:23 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=16 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:23 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:23 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:23 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:23 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:23 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] Creating event network-changed:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:44:23 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-137747c6-5f3b-4e03-9497-70ddf2aec221 req-633340bc-0e78-455a-b3b1-fab4e333899d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040721 Apr 20 17:44:23 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 37/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "name": "network-vif-plugged", "status": "completed", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] Creating event network-vif-plugged:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:44:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-925d727e-66bd-4949-86ec-cb461cd4597f req-f38c29ec-e32a-4fd7-baf9-9455c8441e93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031389 Apr 20 17:44:25 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 35/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "name": "network-vif-plugged", "status": "completed", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=10 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:27 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] Creating event network-vif-plugged:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:44:27 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-1bbb65c4-aa58-4eef-ae2e-e73082459cc5 req-62e341b7-1e04-4d42-8614-d2c8cfb86428 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Apr 20 17:44:27 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-512636972", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "433927b9-c258-4fc3-8c36-ea03b670b240"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] validate_networks() for [('433927b9-c258-4fc3-8c36-ea03b670b240', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Getting quotas for project f3e097e2307a48ada61048d11f4dfdb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Getting quotas for user 0e87e05c599c44b3af17a42d3df1fc14 and project f3e097e2307a48ada61048d11f4dfdb4. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:44:43 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:44:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-f6971469-155f-4772-be84-aaa444141790 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.537169 Apr 20 17:44:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:44:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c3f268ee-2cf8-4db8-a5d1-5cc8d72977da tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c3f268ee-2cf8-4db8-a5d1-5cc8d72977da tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:44 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-c3f268ee-2cf8-4db8-a5d1-5cc8d72977da tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c3f268ee-2cf8-4db8-a5d1-5cc8d72977da tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 200 len: 1210 microversion: 2.1 time: 0.083613 Apr 20 17:44:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 36/111] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:44 2023] GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:46 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-b14cedcb-684d-44e9-ac76-de135116b135 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 200 len: 1544 microversion: 2.1 time: 0.281627 Apr 20 17:44:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:46 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:46 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:46 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] Creating event network-changed:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:44:46 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-f0e9ce9c-30dc-4676-b529-0e556b27c87d req-c1357b27-9f7a-483b-b69f-b310b337a454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026905 Apr 20 17:44:46 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:44:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-91040ce2-9435-45d9-a952-84bea2bc0d1d tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb" status: 204 len: 0 microversion: 2.1 time: 0.174229 Apr 20 17:44:47 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:44:46 2023] DELETE /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:47 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c944a1a40e30441097ea5022becccd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d97029a59944b6a9653c7d7d26d008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:47 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-a0f8da6a-9efc-4e71-a27a-f90d4ad4f2c9 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb" status: 200 len: 1495 microversion: 2.1 time: 0.543510 Apr 20 17:44:47 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:47 2023] GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb => generated 1495 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:48 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "name": "network-vif-unplugged", "status": "completed", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}, {"server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "name": "network-vif-plugged", "status": "completed", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}, {"server_uuid": "be796f9d-448a-485e-bcb2-214b01dbcdfb", "name": "network-vif-deleted", "tag": "269aa65e-fd3c-4ee9-a20e-a3a30128e4ee"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Creating event network-vif-unplugged:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:44:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Creating event network-vif-plugged:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:44:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] Creating event network-vif-deleted:269aa65e-fd3c-4ee9-a20e-a3a30128e4ee for instance be796f9d-448a-485e-bcb2-214b01dbcdfb on user Apr 20 17:44:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-455f183e-46d9-44ce-bc96-f4418c222880 req-fd7fe56f-33e1-4b2d-b026-7561c8276ad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030913 Apr 20 17:44:48 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-7594f468-af94-44dd-af3c-0f0d8da6a41f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.157608 Apr 20 17:44:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 38/117] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:44:49 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f/os-interface => generated 283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:50 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "name": "network-vif-plugged", "status": "completed", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}, {"server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "name": "network-vif-plugged", "status": "completed", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Creating event network-vif-plugged:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:44:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] Creating event network-vif-plugged:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:44:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-085ddc9d-b631-4866-953a-93ba3c1a3a25 req-353e6615-d082-407a-93e4-fff95e057ec7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032595 Apr 20 17:44:50 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:50 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:50 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] Creating event network-changed:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:50 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-b54f69ce-ef7e-4ef5-93fa-277adcf9a14c req-c94b00bf-5085-4ebb-93e7-c44601cfd6bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053630 Apr 20 17:44:50 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:50 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:50 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:51 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-858fe5c5-2917-4bd4-8ab3-31d03133f516 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f/ips" status: 200 len: 105 microversion: 2.1 time: 0.045969 Apr 20 17:44:51 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 39/120] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:44:50 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f/ips => generated 105 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:52 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:44:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-f3bffc75-4da5-4b65-a582-39ed51f37eef tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 204 len: 0 microversion: 2.1 time: 0.188414 Apr 20 17:44:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 41/121] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:44:52 2023] DELETE /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:53 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:53 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-66374869-dd00-40ee-893a-ab20144bc610 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 200 len: 1662 microversion: 2.1 time: 0.345550 Apr 20 17:44:53 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:52 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 1662 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:53 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-unplugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:53 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] Creating event network-vif-unplugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:53 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-bcb10868-a924-44c2-8277-748f611716b8 req-8fb0bdf7-2b45-40df-b4e7-771a4af0b9c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035183 Apr 20 17:44:53 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 40/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:53 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:54 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:44:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-5f5323c5-cd1a-4e4b-8d4f-0c6e87dd27f5 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 200 len: 1536 microversion: 2.1 time: 0.768924 Apr 20 17:44:54 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:44:53 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 1536 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-unplugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] Creating event network-vif-unplugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-044be284-8289-4b9f-8006-13fcbe4414fe req-af64fa6b-5a58-47a2-bf5b-23a534e67b6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.056025 Apr 20 17:44:55 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 43/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:55 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:56 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e0801068-78be-48d3-8337-c9d840e9e5ea tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.151199 Apr 20 17:44:56 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 41/126] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:44:56 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915/os-interface => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:57 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-plugged", "status": "completed", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}, {"server_uuid": "6f5ee5ac-ed9d-4d68-946f-7844b6432d7f", "name": "network-vif-deleted", "tag": "129952a2-65e2-4736-9b00-3aea19b294ce"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Creating event network-vif-plugged:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] Creating event network-vif-deleted:129952a2-65e2-4736-9b00-3aea19b294ce for instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f on user Apr 20 17:44:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-83c0eafa-0e53-483a-8ca8-25284c5eed0a req-e797d429-d26a-4aae-a3c0-c05e22ec3e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.191978 Apr 20 17:44:57 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:57 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] Creating event network-changed:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:44:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-7cb23bb1-aa9a-46e1-8575-794f1e5ca001 req-e5dd697c-8b22-4ca1-86cf-f49176ec7173 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Apr 20 17:44:57 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:44:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1332675957"}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:44:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:44:58 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d0d5a081-289d-4c79-b772-237e69ad4748 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915/action" status: 202 len: 0 microversion: 2.1 time: 1.018416 Apr 20 17:44:58 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 42/129] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 17:44:57 2023] POST /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915/action => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 17:44:58 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d889c764-1438-477f-8842-0a5701294777 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '.version_select at 0x7f342d901c60>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:44:58 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d889c764-1438-477f-8842-0a5701294777 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025" status: 200 len: 1609 microversion: 2.1 time: 0.046378 Apr 20 17:44:58 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 44/130] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 17:44:58 2023] GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025 => generated 1609 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=18 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:09 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:10 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-959e3561-495d-45ae-80ad-0101dda41891 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.237271 Apr 20 17:45:10 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 45/131] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:45:09 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04/os-interface => generated 283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] Creating event network-changed:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:45:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-92133a50-1c8c-4787-a686-9167f89036eb req-b00ba363-291b-474e-ac4b-50751d4ae091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054641 Apr 20 17:45:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:11 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3ad335897b487ba1b386d785ba8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbeddd6447ba44fcba3cd2dfbde3b2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:11 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-91518b67-5b93-4847-ba43-f415d4df7372 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 200 len: 1565 microversion: 2.1 time: 0.450304 Apr 20 17:45:11 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:11 2023] GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 1565 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:12 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Going to try to terminate instance {{(pid=61868) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:45:12 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-6c91432a-a9dc-4f7a-8611-a33b804ce7dd tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 204 len: 0 microversion: 2.1 time: 0.337747 Apr 20 17:45:12 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:45:12 2023] DELETE /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:12 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:13 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efd93562be24b6e8cd642cbd44b003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30dfddf52a146b2861fbe504571ce4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:13 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c4f6f172-d135-4760-887b-5fdcf5df8764 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 200 len: 1674 microversion: 2.1 time: 0.391770 Apr 20 17:45:13 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 44/135] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:12 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 1674 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:13 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "name": "network-vif-unplugged", "status": "completed", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:13 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] Creating event network-vif-unplugged:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:45:13 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-bbc9b69e-e6c2-4c67-9b70-37c5d8d38b0a req-841a5aca-1c6c-4b5e-99e7-6d3b7a4d726f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027034 Apr 20 17:45:13 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:14 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "name": "network-vif-deleted", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:14 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] Creating event network-vif-deleted:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:45:14 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-10956da7-733f-4fc3-993f-76d254a4c381 req-b467cdc1-ab68-4523-903c-f939e9adc6ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030505 Apr 20 17:45:14 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:14 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8ec9c953-160a-44f6-8aa5-2251f47d1544 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.203016 Apr 20 17:45:14 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 45/138] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:45:14 2023] GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20/os-interface => generated 282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:15 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c682f17d-0035-43ac-b8db-1af4ffc71f04", "name": "network-vif-plugged", "status": "completed", "tag": "d62f42bc-e478-41c7-b3e9-6a33c2ac4015"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:15 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:15 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:15 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:15 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] Creating event network-vif-plugged:d62f42bc-e478-41c7-b3e9-6a33c2ac4015 for instance c682f17d-0035-43ac-b8db-1af4ffc71f04 on user Apr 20 17:45:15 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-8e3fb1c5-d1f7-4149-ba1a-8a79d45789dd req-019e3fee-6e0a-446e-9f25-691d5b26d10a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Apr 20 17:45:15 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:16 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:16 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] Creating event network-changed:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:45:16 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-d49cc54c-ca43-4d4a-8fad-84295e80c1bb req-534ef193-ff2f-4890-a6f5-506afd3e96ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027259 Apr 20 17:45:16 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:17 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1977739898", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "dcd79c16-699b-47bf-a62f-a1ff679ca5f8"}]}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:17 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] validate_networks() for [('dcd79c16-699b-47bf-a62f-a1ff679ca5f8', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Getting quotas for user 3bbaba13b37342668437a13b9eb0939b and project 1a7ca478c36a44189905226b0e5ffaaa. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:45:18 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:45:18 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-b422752a-e104-4062-ad22-78cff19e6a6a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.857900 Apr 20 17:45:18 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 46/141] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:45:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:45:18 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-9141edb8-83ab-4ccd-bf72-6353cc04672c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:18 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-9141edb8-83ab-4ccd-bf72-6353cc04672c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:18 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-9141edb8-83ab-4ccd-bf72-6353cc04672c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:18 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-9141edb8-83ab-4ccd-bf72-6353cc04672c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be" status: 200 len: 1212 microversion: 2.1 time: 0.120906 Apr 20 17:45:18 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:18 2023] GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] Creating event network-changed:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:45:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-77f15eab-8ca4-4724-a9b8-bdb4d4a622ff req-6bc94630-0d3a-452f-9f37-f7f457ad35dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Apr 20 17:45:20 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 49/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:22 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "name": "network-vif-plugged", "status": "completed", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:22 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] Creating event network-vif-plugged:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:45:22 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-877ad887-1acd-410c-9222-5c7c3c70186c req-4d7c1331-cfda-4908-a20f-ddb0a4749524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029623 Apr 20 17:45:22 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 47/144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "name": "network-vif-plugged", "status": "completed", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] Creating event network-vif-plugged:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:45:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-c300412e-a1ce-485a-970e-14bca09a2974 req-5ef7865d-879d-492d-b2fa-11ccebdf4ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027290 Apr 20 17:45:24 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:34 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:34 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-12bdd478-7941-49af-b3f4-9a35c48b1089 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 200 len: 1493 microversion: 2.1 time: 0.247333 Apr 20 17:45:34 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 50/146] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:34 2023] GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] [instance: be796f9d-448a-485e-bcb2-214b01dbcdfb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=16 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:37 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] HTTP exception thrown: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Request method failure captured: Apr 20 17:45:37 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb HTTP/1.1 Apr 20 17:45:37 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:45:37 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:45:37 user devstack@n-api.service[61866]: Connection: close Apr 20 17:45:37 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:45:37 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:45:37 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:45:37 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:45:37 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXmayszog91rtC89c3mBND47bEr2PgYh6jWAD9OfaEDDfp_h5lwFswDw9WKSiOF11hdm6aIjHN_VDepkPjt9-_HKVlV_a-ur3QTK3QOAh12ry3v4ZyfItR4r7hz5asvl_jOVJmFSMCzU16RWDDgTWuD7P9yagQV2TmF1PKMtpMn45rA Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Project-Id: 89d97029a59944b6a9653c7d7d26d008 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Project-Name: tempest-DeleteServersTestJSON-790203335 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89d97029a59944b6a9653c7d7d26d008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89d97029a59944b6a9653c7d7d26d008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89d97029a59944b6a9653c7d7d26d008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Tenant: tempest-DeleteServersTestJSON-790203335 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Tenant-Id: 89d97029a59944b6a9653c7d7d26d008 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-DeleteServersTestJSON-790203335 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-User: tempest-DeleteServersTestJSON-790203335-project-member Apr 20 17:45:37 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:45:37 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:45:37 user devstack@n-api.service[61866]: X-User-Id: c944a1a40e30441097ea5022becccd81 Apr 20 17:45:37 user devstack@n-api.service[61866]: X-User-Name: tempest-DeleteServersTestJSON-790203335-project-member Apr 20 17:45:37 user devstack@n-api.service[61866]: method: > Apr 20 17:45:37 user devstack@n-api.service[61866]: exception: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. Apr 20 17:45:37 user devstack@n-api.service[61866]: action_args: {'id': 'be796f9d-448a-485e-bcb2-214b01dbcdfb'} Apr 20 17:45:37 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. Apr 20 17:45:37 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:45:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] Returning 404 to user: Instance be796f9d-448a-485e-bcb2-214b01dbcdfb could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:45:37 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d9fcb397-159c-4635-9dff-714c68abec89 tempest-DeleteServersTestJSON-790203335 tempest-DeleteServersTestJSON-790203335-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb" status: 404 len: 111 microversion: 2.1 time: 0.048779 Apr 20 17:45:37 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 48/147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:37 2023] GET /compute/v2.1/servers/be796f9d-448a-485e-bcb2-214b01dbcdfb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=12 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=12 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:45:43 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f HTTP/1.1 Apr 20 17:45:43 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:45:43 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:45:43 user devstack@n-api.service[61867]: Connection: close Apr 20 17:45:43 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:45:43 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:45:43 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:45:43 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:45:43 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:45:43 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:45:43 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:45:43 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:45:43 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:45:43 user devstack@n-api.service[61867]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:45:43 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:45:43 user devstack@n-api.service[61867]: method: > Apr 20 17:45:43 user devstack@n-api.service[61867]: exception: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:45:43 user devstack@n-api.service[61867]: action_args: {'id': '6f5ee5ac-ed9d-4d68-946f-7844b6432d7f'} Apr 20 17:45:43 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:45:43 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:45:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:45:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-3ac4e21e-c653-42bd-a87b-0f5c26f8f514 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 404 len: 111 microversion: 2.1 time: 0.041920 Apr 20 17:45:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 50/148] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:43 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:45:43 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6639db53-0541-4d28-926b-f8c6fceb9e77 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '.version_select at 0x7f342d961360>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:43 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-6639db53-0541-4d28-926b-f8c6fceb9e77 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126183261" status: 202 len: 0 microversion: 2.1 time: 0.020704 Apr 20 17:45:43 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 17:45:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126183261 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:45:44 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c055ac4a-12c8-4a55-ac0e-016619c195be tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Action: 'create', calling method: .version_select at 0x7f342d82f5b0>, body: {"keypair": {"name": "tempest-keypair-104029701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONqpnmzftoQM06OM1kELdXwFTJlxmcuwiCzkaKG68R5XlCOXmcUj2kOi/20gKS0j2Cw6vnPlO8iUchs2Ol9d7iIbWmcgSMcFzfnvQfoR+x1+rNSFGQ+0VdJux5Wuxvi5Q=="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:44 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-c055ac4a-12c8-4a55-ac0e-016619c195be tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for project d829829f4ef449d4a279c8a702d4c43f. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:45:44 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-c055ac4a-12c8-4a55-ac0e-016619c195be tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for user 7b1d025cf0584fa286870d8232bceb97 and project d829829f4ef449d4a279c8a702d4c43f. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:45:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c055ac4a-12c8-4a55-ac0e-016619c195be tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053039 Apr 20 17:45:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 49/150] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:45:44 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:45 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1610138425", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a8d6d208-ea97-4ed8-9275-a5b494bca17f"}], "security_groups": [{"name": "tempest-securitygroup--1944705277"}], "key_name": "tempest-keypair-104029701", "user_data": "}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:45 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] validate_networks() for [('a8d6d208-ea97-4ed8-9275-a5b494bca17f', None, None, None, None, None)] {{(pid=61867) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Flavor limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Image limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Flavor pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Image pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for project d829829f4ef449d4a279c8a702d4c43f. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Getting quotas for user 7b1d025cf0584fa286870d8232bceb97 and project d829829f4ef449d4a279c8a702d4c43f. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Going to run 1 instances... {{(pid=61867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:45:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:45:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-fed13a64-3b63-4d73-a403-0d9afb1f8178 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.988114 Apr 20 17:45:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:45:45 2023] POST /compute/v2.1/servers => generated 400 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:45:46 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:45:46 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-e2fbfa4c-980d-4218-8515-365d7fdcf66f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:46 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-e2fbfa4c-980d-4218-8515-365d7fdcf66f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:46 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-e2fbfa4c-980d-4218-8515-365d7fdcf66f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:46 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-e2fbfa4c-980d-4218-8515-365d7fdcf66f tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 200 len: 1231 microversion: 2.1 time: 0.078537 Apr 20 17:45:46 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:46 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 1231 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c27829cf-61dd-4195-91de-f983b4d5c728 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.324343 Apr 20 17:45:47 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:45:46 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316/os-interface => generated 283 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:48 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:48 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:48 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:48 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:48 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] Creating event network-changed:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:45:48 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-39aed389-6029-4f71-b564-ac1e62a3c68a req-4b6a965c-68c3-4953-9b16-9e30cffb0779 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041001 Apr 20 17:45:48 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-1929f047-5eb6-4979-bf45-6ae5bdd756b5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316/ips" status: 200 len: 109 microversion: 2.1 time: 0.040021 Apr 20 17:45:48 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:45:48 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:48 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8c138042-efcb-41d5-aa39-97e758270844 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '.version_select at 0x7f342da44550>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8c138042-efcb-41d5-aa39-97e758270844 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025" status: 200 len: 1723 microversion: 2.1 time: 0.057867 Apr 20 17:45:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 51/156] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 17:45:48 2023] GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025 => generated 1723 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-648a94d3-6bb5-441a-925a-36d8accf2d97 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '.version_select at 0x7f342d8cd000>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:49 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-648a94d3-6bb5-441a-925a-36d8accf2d97 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025" status: 200 len: 1723 microversion: 2.1 time: 0.056925 Apr 20 17:45:49 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 53/157] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 17:45:49 2023] GET /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025 => generated 1723 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:49 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c1ddc4186b4234a18271673ea42a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b7e93a856468e831596fbf4a085bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:49 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-08adea63-86e1-42a3-aab7-015bde9a2b39 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 200 len: 1670 microversion: 2.1 time: 0.236005 Apr 20 17:45:49 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:49 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] Creating event network-changed:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:45:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-c748ce71-06b9-4d65-91ae-1eb4485e0894 req-546f1a26-3337-4d32-8c8d-925453cae5e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037591 Apr 20 17:45:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 52/159] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:49 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:45:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-12c2b98f-bfaa-43df-b42f-c4e5577f30c3 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 204 len: 0 microversion: 2.1 time: 0.139179 Apr 20 17:45:50 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:45:49 2023] DELETE /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:50 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:50 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "name": "network-vif-unplugged", "status": "completed", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:50 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-ce0debcb-40a8-44f8-882b-015b29dd42d7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 200 len: 1669 microversion: 2.1 time: 0.326514 Apr 20 17:45:50 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:50 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:50 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] Creating event network-vif-unplugged:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:45:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-54540fbe-b951-47cb-96c2-fdb26856cb78 req-69640a7a-36a1-444b-aba1-1d1d06ea7fa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030574 Apr 20 17:45:50 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 55/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:50 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-91ee1fff-f555-4c18-b356-6257f8e5dce6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Action: 'create', calling method: .version_select at 0x7f342da46c20>, body: {"keypair": {"name": "tempest-keypair-153238431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0FCE4Hd5+8kyNvpNl2KHRcs4SXhbcKZoAUgDW4toGd+/8aTk/dpA2JB11JoIQOeQsSibEMbQUvHTQ3iGn6ntfNgFrJjvaGNhky7ECWJ7J6Bnko4N2UR4obewVGkvyvAA=="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:50 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-91ee1fff-f555-4c18-b356-6257f8e5dce6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Getting quotas for project e71be84bd42247d580074ab83b838bb7. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:45:50 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-91ee1fff-f555-4c18-b356-6257f8e5dce6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Getting quotas for user e1845b9cd94240a29608d4ebbd39e9a5 and project e71be84bd42247d580074ab83b838bb7. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:45:50 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-91ee1fff-f555-4c18-b356-6257f8e5dce6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179171 Apr 20 17:45:50 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 53/163] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:45:50 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1857624308", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ed65bd69-a316-44d7-8213-4ae158923539"}], "security_groups": [{"name": "tempest-securitygroup--1383347423"}], "key_name": "tempest-keypair-153238431", "user_data": "}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] validate_networks() for [('ed65bd69-a316-44d7-8213-4ae158923539', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "name": "network-vif-plugged", "status": "completed", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] Creating event network-vif-plugged:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:45:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-7528a86a-9c5f-42ad-ba8d-a0549847095e req-8d06618f-100a-4e0b-8368-720e46921c56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038003 Apr 20 17:45:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:52 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "name": "network-vif-plugged", "status": "completed", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:52 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:52 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] Creating event network-vif-plugged:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:45:52 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-c2733645-eaed-446a-b18d-fbb4d31b0c4d req-cd867e96-13e6-4440-a3de-21a13536fa68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030128 Apr 20 17:45:52 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 54/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Getting quotas for project e71be84bd42247d580074ab83b838bb7. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Getting quotas for user e1845b9cd94240a29608d4ebbd39e9a5 and project e71be84bd42247d580074ab83b838bb7. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:45:52 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:45:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-2b406242-1f46-4fc0-a866-35a856c16c08 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.763384 Apr 20 17:45:52 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 56/166] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:45:52 2023] POST /compute/v2.1/servers => generated 407 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-808ffcc8-b689-43f2-b0ae-2da18afedccf tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-808ffcc8-b689-43f2-b0ae-2da18afedccf tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:52 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-808ffcc8-b689-43f2-b0ae-2da18afedccf tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-808ffcc8-b689-43f2-b0ae-2da18afedccf tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1232 microversion: 2.1 time: 0.066722 Apr 20 17:45:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:52 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1232 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf308e1b-0bae-462d-94d9-fcb90d51b316", "name": "network-vif-deleted", "tag": "04eb58cb-37ab-49ce-8704-284557489a14"}, {"server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "name": "network-vif-plugged", "status": "completed", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Creating event network-vif-deleted:04eb58cb-37ab-49ce-8704-284557489a14 for instance bf308e1b-0bae-462d-94d9-fcb90d51b316 on user Apr 20 17:45:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] Creating event network-vif-plugged:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:45:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-115fd98d-8de4-4a2b-bda6-399db5763d36 req-d5960113-8bc1-403b-aac0-a42661346a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042757 Apr 20 17:45:54 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 55/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:54 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-3d24802d-442b-48ef-a33a-a57370cca88d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 200 len: 1536 microversion: 2.1 time: 0.238232 Apr 20 17:45:54 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:54 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 1536 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Searching by: {'deleted': False, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b'} {{(pid=61867) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61867]: DEBUG nova.compute.multi_cell_list [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61867) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 17:45:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-b178a934-057b-425c-a4b4-dd9e0b2ff116 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.206154 Apr 20 17:45:54 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 58/170] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 17:45:54 2023] GET /compute/v2.1/servers => generated 341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:54 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:55 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:55 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e03e1d5a-7576-4f5e-8790-756055b71748 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 200 len: 1536 microversion: 2.1 time: 0.369361 Apr 20 17:45:55 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 56/171] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:54 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 1536 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:56 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] Creating event network-changed:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:45:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-ac2b0e9f-24d2-4e90-b76b-f8fa0becd6e0 req-94347bb4-8bd0-4ae1-bffd-eb95305c9ece service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038694 Apr 20 17:45:56 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 58/172] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:56 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:45:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-69eb8077-575b-4048-9d85-7aa4b926fbeb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 204 len: 0 microversion: 2.1 time: 0.124147 Apr 20 17:45:57 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:45:56 2023] DELETE /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:57 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:45:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-7fa00439-7e33-4448-8c19-3a9748bf33b2 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 200 len: 1542 microversion: 2.1 time: 0.142519 Apr 20 17:45:57 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 57/174] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:45:57 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 1542 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:45:57 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "name": "network-vif-unplugged", "status": "completed", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] Creating event network-vif-unplugged:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:45:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-ec238fe2-f459-4455-9ae6-6f8a7ab1a8fe req-bcb30339-2bfe-49a4-922b-106bc963153b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033909 Apr 20 17:45:57 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:57 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "name": "network-vif-plugged", "status": "completed", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:57 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] Creating event network-vif-plugged:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:45:57 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-c86a2b84-f877-46ea-9102-4e178460eb51 req-0789e090-93f2-4b11-b96d-28dea6ddd01a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035895 Apr 20 17:45:57 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 60/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:58 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "name": "network-vif-deleted", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:58 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:58 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:58 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:58 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] Creating event network-vif-deleted:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:45:58 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-edf585fe-8e72-4dd9-8447-32228313ddeb req-73a9ec30-f5bd-4a99-a3cc-79bed122e6dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038590 Apr 20 17:45:58 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 58/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:59 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48711e22-a0b9-4a46-9395-8f384324d82d", "name": "network-vif-plugged", "status": "completed", "tag": "ed25e463-200d-45ea-bf4b-4e476728af6c"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:59 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:59 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:59 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:59 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] Creating event network-vif-plugged:ed25e463-200d-45ea-bf4b-4e476728af6c for instance 48711e22-a0b9-4a46-9395-8f384324d82d on user Apr 20 17:45:59 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-bd8e2ed4-2888-433f-8f30-cfda86034d83 req-616e25bf-aa28-4351-9fcf-a26a13860f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031357 Apr 20 17:45:59 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 60/178] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:45:59 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "name": "network-vif-plugged", "status": "completed", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:45:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:45:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:45:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:45:59 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] Creating event network-vif-plugged:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:45:59 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-3263ff92-d3fa-4aeb-b3d8-c83f1dc8019c req-cd78d9b1-7910-49c1-ac19-7145e402a5d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033758 Apr 20 17:45:59 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=8 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] HTTP exception thrown: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Request method failure captured: Apr 20 17:46:03 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 HTTP/1.1 Apr 20 17:46:03 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:46:03 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:46:03 user devstack@n-api.service[61866]: Connection: close Apr 20 17:46:03 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:46:03 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:46:03 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:46:03 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:46:03 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXmZGP1ohpT9ps7zeADNB3QrkNVd1qXmBAdzcHDfDDiuZtRoV_GIbkQ4U78c-j1NU5G4lZ3ryt6LgQAjX-YZzd2bnQXXnKprNvGpoehXX0IqpgNgTFTYQ_RaAXvsVaUgVqqJGiXHF4qjsT6xDRtwQUZK8poYdKsRmmQaDcqM0gj7Kmk Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Project-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Tenant-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:03 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:03 user devstack@n-api.service[61866]: X-User: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:03 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:46:03 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:46:03 user devstack@n-api.service[61866]: X-User-Id: 7efd93562be24b6e8cd642cbd44b003f Apr 20 17:46:03 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:03 user devstack@n-api.service[61866]: method: > Apr 20 17:46:03 user devstack@n-api.service[61866]: exception: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:03 user devstack@n-api.service[61866]: action_args: {'id': 'c682f17d-0035-43ac-b8db-1af4ffc71f04'} Apr 20 17:46:03 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:03 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:03 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Returning 404 to user: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:46:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-79f9a929-0b19-47d6-a604-43add5c47c66 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 404 len: 111 microversion: 2.1 time: 0.032010 Apr 20 17:46:03 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 59/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:03 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:46:03 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:03 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=8 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:03 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-faf8a611-a31b-456d-a9fe-a209e7901dd7 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '.version_select at 0x7f342d963a30>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-faf8a611-a31b-456d-a9fe-a209e7901dd7 tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051272814" status: 202 len: 0 microversion: 2.1 time: 0.036047 Apr 20 17:46:03 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 17:46:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051272814 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=8 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:04 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] HTTP exception thrown: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Request method failure captured: Apr 20 17:46:04 user devstack@n-api.service[61867]: request: DELETE /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 HTTP/1.1 Apr 20 17:46:04 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:46:04 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:46:04 user devstack@n-api.service[61867]: Connection: close Apr 20 17:46:04 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:46:04 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:46:04 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:46:04 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:46:04 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmZGP1ohpT9ps7zeADNB3QrkNVd1qXmBAdzcHDfDDiuZtRoV_GIbkQ4U78c-j1NU5G4lZ3ryt6LgQAjX-YZzd2bnQXXnKprNvGpoehXX0IqpgNgTFTYQ_RaAXvsVaUgVqqJGiXHF4qjsT6xDRtwQUZK8poYdKsRmmQaDcqM0gj7Kmk Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Project-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Tenant-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:04 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61867]: X-User: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:04 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:46:04 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:46:04 user devstack@n-api.service[61867]: X-User-Id: 7efd93562be24b6e8cd642cbd44b003f Apr 20 17:46:04 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:04 user devstack@n-api.service[61867]: method: > Apr 20 17:46:04 user devstack@n-api.service[61867]: exception: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61867]: action_args: {'id': 'c682f17d-0035-43ac-b8db-1af4ffc71f04'} Apr 20 17:46:04 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Returning 404 to user: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:46:04 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bcc4863a-a305-494c-8167-c262a6622a4d tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 404 len: 111 microversion: 2.1 time: 0.034391 Apr 20 17:46:04 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 62/182] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:46:04 2023] DELETE /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] [instance: c682f17d-0035-43ac-b8db-1af4ffc71f04] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:04 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] HTTP exception thrown: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Request method failure captured: Apr 20 17:46:04 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 HTTP/1.1 Apr 20 17:46:04 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:46:04 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:46:04 user devstack@n-api.service[61866]: Connection: close Apr 20 17:46:04 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:46:04 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:46:04 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:46:04 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:46:04 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXmZGP1ohpT9ps7zeADNB3QrkNVd1qXmBAdzcHDfDDiuZtRoV_GIbkQ4U78c-j1NU5G4lZ3ryt6LgQAjX-YZzd2bnQXXnKprNvGpoehXX0IqpgNgTFTYQ_RaAXvsVaUgVqqJGiXHF4qjsT6xDRtwQUZK8poYdKsRmmQaDcqM0gj7Kmk Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Project-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d30dfddf52a146b2861fbe504571ce4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Tenant-Id: d30dfddf52a146b2861fbe504571ce4e Apr 20 17:46:04 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-6016924 Apr 20 17:46:04 user devstack@n-api.service[61866]: X-User: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:04 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:46:04 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:46:04 user devstack@n-api.service[61866]: X-User-Id: 7efd93562be24b6e8cd642cbd44b003f Apr 20 17:46:04 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-6016924-project-member Apr 20 17:46:04 user devstack@n-api.service[61866]: method: > Apr 20 17:46:04 user devstack@n-api.service[61866]: exception: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61866]: action_args: {'id': 'c682f17d-0035-43ac-b8db-1af4ffc71f04'} Apr 20 17:46:04 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. Apr 20 17:46:04 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] Returning 404 to user: Instance c682f17d-0035-43ac-b8db-1af4ffc71f04 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:46:04 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5ae0e11c-68b0-4fea-890f-45f5dacee96f tempest-AttachSCSIVolumeTestJSON-6016924 tempest-AttachSCSIVolumeTestJSON-6016924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04" status: 404 len: 111 microversion: 2.1 time: 0.032212 Apr 20 17:46:04 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 60/183] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:04 2023] GET /compute/v2.1/servers/c682f17d-0035-43ac-b8db-1af4ffc71f04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:08 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:08 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-68d30140-0544-4efa-b5f0-829559743311 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be" status: 200 len: 1497 microversion: 2.1 time: 0.405874 Apr 20 17:46:08 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:08 2023] GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:12 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3ad335897b487ba1b386d785ba8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbeddd6447ba44fcba3cd2dfbde3b2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:12 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-0f87f89d-0662-4d24-b6cf-2304639b7402 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 200 len: 1565 microversion: 2.1 time: 0.264124 Apr 20 17:46:12 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:12 2023] GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 1565 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=31 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:13 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:46:13 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-425e9ea5-a4b8-4324-8eac-6d4b2400717c tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 204 len: 0 microversion: 2.1 time: 0.115988 Apr 20 17:46:13 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 61/186] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:46:13 2023] DELETE /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:14 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:14 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] Creating event network-vif-unplugged:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:46:14 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-4d8cafe9-d8b0-446b-b52a-941175e378e5 req-37f2a87b-2cec-4eda-9e3c-fec48e95c32f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041626 Apr 20 17:46:14 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:14 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3ad335897b487ba1b386d785ba8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbeddd6447ba44fcba3cd2dfbde3b2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:14 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-92094028-ae49-40fb-b658-6e89e059ab40 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 200 len: 1571 microversion: 2.1 time: 0.502895 Apr 20 17:46:14 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:14 2023] GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 1571 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:15 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "name": "network-vif-deleted", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] Creating event network-vif-deleted:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:46:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-28cd5ee9-4cca-4560-afb8-49cc23664341 req-064520e0-5780-47c9-b6b3-65c0ca594759 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Apr 20 17:46:15 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 62/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bc8db4-526a-453b-a3d5-2b1a206d9667", "name": "network-vif-plugged", "status": "completed", "tag": "e4b97326-7a66-4211-908c-86c1ad98e1ff"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] Creating event network-vif-plugged:e4b97326-7a66-4211-908c-86c1ad98e1ff for instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 on user Apr 20 17:46:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-a7ee5c4d-6d97-4cec-9f34-d8151037eb04 req-841fccdb-75fd-4233-8c8b-e6162db3ccd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Apr 20 17:46:16 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=42 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:34 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Going to try to terminate instance {{(pid=61868) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:46:34 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-32a0de59-51b8-49fa-83c0-6d0212a5ece6 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 204 len: 0 microversion: 2.1 time: 0.113169 Apr 20 17:46:34 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:46:34 2023] DELETE /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "name": "network-vif-unplugged", "status": "completed", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] Creating event network-vif-unplugged:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:46:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-df5b44d1-b247-4ec1-a299-904824afc524 req-f6bdcea6-2915-4c15-a69f-f6113cf69dc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041059 Apr 20 17:46:34 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 66/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:34 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:34 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-77ea02ae-fd47-4f63-82c2-d3db114a819b tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 200 len: 1499 microversion: 2.1 time: 0.279783 Apr 20 17:46:34 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 63/193] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:34 2023] GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 1499 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:36 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "name": "network-vif-plugged", "status": "completed", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}, {"server_uuid": "144ff119-1608-45ca-bd96-e648560c0a48", "name": "network-vif-deleted", "tag": "0436cd40-157f-4a1e-80d6-18b44cefa80b"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:36 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:36 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:36 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:36 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Creating event network-vif-plugged:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:46:36 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] Creating event network-vif-deleted:0436cd40-157f-4a1e-80d6-18b44cefa80b for instance 144ff119-1608-45ca-bd96-e648560c0a48 on user Apr 20 17:46:36 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-b021a0ce-4b7d-4124-8c1a-2cd2da7d3167 req-259d6f40-96b2-4824-bde9-a10934b4177b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028511 Apr 20 17:46:36 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 67/194] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:36 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:36 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-cab4f370-5a2d-4931-b0fa-f7c58d591926 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 200 len: 1538 microversion: 2.1 time: 0.288795 Apr 20 17:46:36 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 65/195] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:36 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 1538 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:40 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:46:40 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 HTTP/1.1 Apr 20 17:46:40 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:46:40 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:46:40 user devstack@n-api.service[61866]: Connection: close Apr 20 17:46:40 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:46:40 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:46:40 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:46:40 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:46:40 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:46:40 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:46:40 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:46:40 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:46:40 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:46:40 user devstack@n-api.service[61866]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:46:40 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:46:40 user devstack@n-api.service[61866]: method: > Apr 20 17:46:40 user devstack@n-api.service[61866]: exception: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:46:40 user devstack@n-api.service[61866]: action_args: {'id': 'bf308e1b-0bae-462d-94d9-fcb90d51b316'} Apr 20 17:46:40 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:46:40 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:46:40 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:46:40 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-1fc6a9cc-da4b-4dde-9dd3-91beced8fa4a tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 404 len: 111 microversion: 2.1 time: 0.026524 Apr 20 17:46:40 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:40 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:46:40 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-0748cb42-641d-414b-9fa6-e0c848ee7248 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '.version_select at 0x7f342d8ccaf0>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:40 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-0748cb42-641d-414b-9fa6-e0c848ee7248 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19367170" status: 202 len: 0 microversion: 2.1 time: 0.021933 Apr 20 17:46:40 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 68/197] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 17:46:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19367170 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:46:41 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-777f8926-6b0e-43f2-b4fe-feb5530145c5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: .version_select at 0x7f342d9ca050>, body: {"keypair": {"name": "tempest-keypair-340400566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMyR5wL7JJfVFfMvlB/Gfafks/fqPtFk/qHPZIBc3ey0qoe7/nLD1dccvaDD/etjMjoHpbu6dQg6zHTr8h3/I4RO1di4RXcnC2MjxPyAe8SPtpJEC9drdMVWCrUVcc+g=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:41 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-777f8926-6b0e-43f2-b4fe-feb5530145c5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:46:41 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-777f8926-6b0e-43f2-b4fe-feb5530145c5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:46:41 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-777f8926-6b0e-43f2-b4fe-feb5530145c5 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.041684 Apr 20 17:46:41 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:46:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:42 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945027219", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "81717015-dd1b-405e-b3be-87c2e48c6e76"}], "security_groups": [{"name": "tempest-securitygroup--1570796393"}], "key_name": "tempest-keypair-340400566", "user_data": "}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] validate_networks() for [('81717015-dd1b-405e-b3be-87c2e48c6e76', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:46:43 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-393c67ef-c828-4e15-a3c6-701fd6007445 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1539 microversion: 2.1 time: 0.344872 Apr 20 17:46:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 69/199] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:42 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1539 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:46:43 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:46:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8602eb10-828c-46da-b30d-dfd795e951e6 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.221201 Apr 20 17:46:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 65/200] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:46:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:46:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0240c81c-800f-4457-846d-490a407d0987 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-0240c81c-800f-4457-846d-490a407d0987 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:44 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-0240c81c-800f-4457-846d-490a407d0987 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-0240c81c-800f-4457-846d-490a407d0987 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 200 len: 1234 microversion: 2.1 time: 0.057043 Apr 20 17:46:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:44 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 1234 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:45 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2060980566", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "699d9e3b-82b5-48ec-913e-e64620fd3440"}]}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:45 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] validate_networks() for [('699d9e3b-82b5-48ec-913e-e64620fd3440', None, None, None, None, None)] {{(pid=61867) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for user 33fc090f5bc6478a958614985155d7f1 and project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Going to run 1 instances... {{(pid=61867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:46:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:46:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-009f3062-5ec9-42dc-aa0e-2b71330c0444 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.977762 Apr 20 17:46:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 70/202] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:46:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:46:46 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:46 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:46 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:46 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:46 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-2e556aa4-2096-41eb-9c05-003b6ef80e94 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 200 len: 1395 microversion: 2.87 time: 0.077980 Apr 20 17:46:46 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 66/203] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:46:46 2023] GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 1395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 48711e22-a0b9-4a46-9395-8f384324d82d] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:47 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] HTTP exception thrown: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Request method failure captured: Apr 20 17:46:47 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d HTTP/1.1 Apr 20 17:46:47 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:46:47 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:46:47 user devstack@n-api.service[61868]: Connection: close Apr 20 17:46:47 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:46:47 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:46:47 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:46:47 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:46:47 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXnXvJuaAnltnaE0pHF2OGRxCxku1YYLsg8kfyQ4zoTAtiLJqvgXFDtIDb9fEWSx-omezKktPp4GXaMavJ4j_RD9BwLoOe3UjUulWre4fKqquZnC0DU9pRuX9rXuFg432uJTjR85wF1n6hUsUjUXL9GSs04JJyew4NITTmRXyG46E7w Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Project-Id: a9b4fb65c2cd4247906c8211fa5bc56b Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Project-Name: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Tenant: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Tenant-Id: a9b4fb65c2cd4247906c8211fa5bc56b Apr 20 17:46:47 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:46:47 user devstack@n-api.service[61868]: X-User: tempest-TestMinimumBasicScenario-907639887-project-member Apr 20 17:46:47 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:46:47 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:46:47 user devstack@n-api.service[61868]: X-User-Id: bfeb17aa1177414ea2f2a8dc310670b4 Apr 20 17:46:47 user devstack@n-api.service[61868]: X-User-Name: tempest-TestMinimumBasicScenario-907639887-project-member Apr 20 17:46:47 user devstack@n-api.service[61868]: method: > Apr 20 17:46:47 user devstack@n-api.service[61868]: exception: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. Apr 20 17:46:47 user devstack@n-api.service[61868]: action_args: {'id': '48711e22-a0b9-4a46-9395-8f384324d82d'} Apr 20 17:46:47 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. Apr 20 17:46:47 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:46:47 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Returning 404 to user: Instance 48711e22-a0b9-4a46-9395-8f384324d82d could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:46:47 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-c225178f-f678-4fdc-97f1-7a4d36bbfafb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d" status: 404 len: 111 microversion: 2.1 time: 0.040250 Apr 20 17:46:47 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:47 2023] GET /compute/v2.1/servers/48711e22-a0b9-4a46-9395-8f384324d82d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:46:47 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-f7253b4c-75f1-4720-a6d8-67d8c26314fb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '.version_select at 0x7f342d8cde10>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:47 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:47 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-f7253b4c-75f1-4720-a6d8-67d8c26314fb tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-640193228" status: 202 len: 0 microversion: 2.1 time: 0.024229 Apr 20 17:46:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:47 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 71/205] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 17:46:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-640193228 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:46:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] Creating event network-changed:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:46:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-25c4efc3-b008-412c-b98b-1940f6c51d4a req-1cadb475-cc17-4f0d-a01d-821a20bc8b89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Apr 20 17:46:47 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 67/206] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "name": "network-vif-plugged", "status": "completed", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:49 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] Creating event network-vif-plugged:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:46:49 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-420ac554-beb9-4492-b693-3e48590e42e6 req-a8491dd2-ae99-4323-a99f-e338c7f61af9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038668 Apr 20 17:46:49 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d70a5773-e9cf-426a-b659-1203edcd028a tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Action: 'create', calling method: .version_select at 0x7f342d980dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1985986764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFmb3XTS8D2gR29vzCaHQKw/zbaRtd68qksZzxC8KfRRLNJ0qlMy0VHtv/I3H9XjzbFHEN17MsZ+og434HPkCdGhdeHczzS64YHnKxPrb1IJ5GaY8cGJI254n+Ym5Gnlg=="}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-d70a5773-e9cf-426a-b659-1203edcd028a tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-d70a5773-e9cf-426a-b659-1203edcd028a tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for user bfeb17aa1177414ea2f2a8dc310670b4 and project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'key_pairs'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:46:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d70a5773-e9cf-426a-b659-1203edcd028a tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053132 Apr 20 17:46:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 68/208] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:46:49 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-906756997", "imageRef": "fe2c67e2-fc00-473c-81a8-6b8049c509e4", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1985986764", "networks": [{"uuid": "4569ce3e-4c90-488e-b4f7-feb6c08602aa"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:49 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] Creating event network-changed:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:46:49 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] validate_networks() for [('4569ce3e-4c90-488e-b4f7-feb6c08602aa', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:46:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-d7b7db66-cb00-4084-8cc4-41d2ffb42a14 req-6e8e65c9-1cc7-4079-8e2f-aa0d3f41a75a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031930 Apr 20 17:46:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:50 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c1ddc4186b4234a18271673ea42a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b7e93a856468e831596fbf4a085bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:50 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-aee838b3-0162-4314-9181-652ccfce3c05 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 200 len: 1670 microversion: 2.1 time: 0.339995 Apr 20 17:46:50 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:49 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Getting quotas for user bfeb17aa1177414ea2f2a8dc310670b4 and project a9b4fb65c2cd4247906c8211fa5bc56b. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:46:50 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe2c67e2-fc00-473c-81a8-6b8049c509e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:46:50 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-a0bcc575-093e-49ad-bc2d-b7f4f123c723 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.621192 Apr 20 17:46:50 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 70/211] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:46:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:46:50 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-9ee62b37-1b3c-4f12-8cbd-0b7d9415893b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:50 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-9ee62b37-1b3c-4f12-8cbd-0b7d9415893b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:50 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-9ee62b37-1b3c-4f12-8cbd-0b7d9415893b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:50 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-9ee62b37-1b3c-4f12-8cbd-0b7d9415893b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 200 len: 1252 microversion: 2.1 time: 0.063992 Apr 20 17:46:50 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:50 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 1252 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "name": "network-vif-plugged", "status": "completed", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:51 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] Creating event network-vif-plugged:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:46:51 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-b9eb15a0-84c1-47ca-8bbb-14dda28f2352 req-c8884cbd-b2eb-4a27-8a2d-55b137e9d691 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Apr 20 17:46:51 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 73/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-45cae8fc-52de-4c6d-9b50-b5566e7d529e tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '.version_select at 0x7f342d962d40>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:51 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-45cae8fc-52de-4c6d-9b50-b5566e7d529e tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025" status: 204 len: 0 microversion: 2.1 time: 0.235191 Apr 20 17:46:51 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:51 2023] DELETE /compute/v2.1/images/a07a5369-cd4d-45b0-9499-ca6ccfbe6025 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:51 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:46:51 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-92ac3d67-1cfc-47e1-b706-477ca0d39174 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 204 len: 0 microversion: 2.1 time: 0.149764 Apr 20 17:46:51 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 71/215] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:46:51 2023] DELETE /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:46:51 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "name": "network-vif-plugged", "status": "completed", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:52 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c1ddc4186b4234a18271673ea42a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b7e93a856468e831596fbf4a085bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:46:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] Creating event network-vif-plugged:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:46:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-2bb2e806-e18a-428c-8658-50847002f048 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 200 len: 1676 microversion: 2.1 time: 0.272469 Apr 20 17:46:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:46:51 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 1676 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 17:46:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-665e89a4-b0ec-4319-86fb-a72d75b05f0a req-81f727b2-cfc2-4418-bb9c-b6f70bf5a5cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098562 Apr 20 17:46:52 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:53 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "name": "network-vif-unplugged", "status": "completed", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}, {"server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "name": "network-vif-plugged", "status": "completed", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:53 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:53 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Creating event network-vif-unplugged:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:46:53 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] Creating event network-vif-plugged:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:46:53 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-87b1498d-b88e-4eaf-b1d5-56c5437aa8a8 req-ccffdc6d-1d4d-4faf-9405-56e62e563dfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033089 Apr 20 17:46:53 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 72/218] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:54 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "name": "network-vif-plugged", "status": "completed", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}, {"name": "network-changed", "server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Creating event network-vif-plugged:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:46:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] Creating event network-changed:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:46:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-ab7c4229-0bf0-4b90-8a57-471b1a96f62b req-c584d1b7-ebd9-4947-ac50-78b937d38984 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033082 Apr 20 17:46:54 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 75/219] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:56 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398193c-27e0-4e9f-a846-258790e2b915", "name": "network-vif-deleted", "tag": "471e3e93-43f1-4e36-b582-7d8a2e9a10d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:56 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] Creating event network-vif-deleted:471e3e93-43f1-4e36-b582-7d8a2e9a10d6 for instance a398193c-27e0-4e9f-a846-258790e2b915 on user Apr 20 17:46:56 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-12ca0113-dd22-47ac-ba2a-ebd595ee3489 req-f4b4c2fd-28c7-4686-b8db-8a041e60fcea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028795 Apr 20 17:46:56 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 73/220] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:56 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:56 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "name": "network-vif-plugged", "status": "completed", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:56 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:56 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] Creating event network-vif-plugged:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:46:56 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-f752c7cd-e182-4b36-91ed-c95b9b47cdcc req-63eb0650-788b-4f54-9578-9c1b8859d71f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031046 Apr 20 17:46:56 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 73/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "name": "network-vif-plugged", "status": "completed", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:46:58 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:46:58 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] Creating event network-vif-plugged:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:46:58 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-7c0fb86e-f9dc-4890-9848-233ba64ca7bc req-20e37821-b79f-49bd-bd62-59ccaee9a1fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034543 Apr 20 17:46:58 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 76/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=12 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] [instance: 20bc8db4-526a-453b-a3d5-2b1a206d9667] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:04 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] HTTP exception thrown: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Request method failure captured: Apr 20 17:47:04 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 HTTP/1.1 Apr 20 17:47:04 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:47:04 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:47:04 user devstack@n-api.service[61868]: Connection: close Apr 20 17:47:04 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:47:04 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:47:04 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:47:04 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:47:04 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXnsXNmsYLNNvcRTDatlo0bvJ7sJhXOhDUoxIaydKHqBLR5YTi3VlNS7d26J5Y_zkLCssXrtfE5F2cC8x6C0eHrq8RjWXiz-B0PgNzTUFDihiWdJ4BxiGRyOlrMw1KA4wZZrFuxEXRnvSMyUsGUWzk0rjkNGfEA1m4KQnGLURcQ7Tdo Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Project-Id: bbeddd6447ba44fcba3cd2dfbde3b2f5 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1209554196 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbeddd6447ba44fcba3cd2dfbde3b2f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bbeddd6447ba44fcba3cd2dfbde3b2f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbeddd6447ba44fcba3cd2dfbde3b2f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Tenant: tempest-SnapshotDataIntegrityTests-1209554196 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Tenant-Id: bbeddd6447ba44fcba3cd2dfbde3b2f5 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1209554196 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-User: tempest-SnapshotDataIntegrityTests-1209554196-project-member Apr 20 17:47:04 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:47:04 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:47:04 user devstack@n-api.service[61868]: X-User-Id: 2f3ad335897b487ba1b386d785ba8fd3 Apr 20 17:47:04 user devstack@n-api.service[61868]: X-User-Name: tempest-SnapshotDataIntegrityTests-1209554196-project-member Apr 20 17:47:04 user devstack@n-api.service[61868]: method: > Apr 20 17:47:04 user devstack@n-api.service[61868]: exception: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. Apr 20 17:47:04 user devstack@n-api.service[61868]: action_args: {'id': '20bc8db4-526a-453b-a3d5-2b1a206d9667'} Apr 20 17:47:04 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. Apr 20 17:47:04 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:47:04 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Returning 404 to user: Instance 20bc8db4-526a-453b-a3d5-2b1a206d9667 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:47:04 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-a49fa9db-e3d8-4dcb-a3a1-f87a8e487581 tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667" status: 404 len: 111 microversion: 2.1 time: 0.031309 Apr 20 17:47:04 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:04 2023] GET /compute/v2.1/servers/20bc8db4-526a-453b-a3d5-2b1a206d9667 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:47:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=14 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:04 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-03292c09-adb7-4a75-8024-2eec439b5bcf tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] Calling method '.version_select at 0x7f342d82f0a0>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:04 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:04 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-03292c09-adb7-4a75-8024-2eec439b5bcf tempest-SnapshotDataIntegrityTests-1209554196 tempest-SnapshotDataIntegrityTests-1209554196-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-27470692" status: 202 len: 0 microversion: 2.1 time: 0.177906 Apr 20 17:47:04 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 17:47:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-27470692 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=30 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:10 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:47:10 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-e90968cd-a4bb-4f9d-82b7-7b83bbc2da7c tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be" status: 204 len: 0 microversion: 2.1 time: 0.128567 Apr 20 17:47:10 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 77/225] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:47:10 2023] DELETE /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:10 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:10 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "name": "network-vif-unplugged", "status": "completed", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] Creating event network-vif-unplugged:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:47:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-9cd22e6a-f6eb-4f85-a66c-899cfa38f63e req-5d9cc14e-34d4-4ca7-9b5a-084746359944 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045269 Apr 20 17:47:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 75/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:10 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:10 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-bc409e8f-789a-418c-8a5c-22e1240b146e tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be" status: 200 len: 1503 microversion: 2.1 time: 0.415491 Apr 20 17:47:10 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:10 2023] GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be => generated 1503 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:13 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "name": "network-vif-plugged", "status": "completed", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}, {"server_uuid": "ea4895e7-967c-4eda-bbc1-fe357601c5be", "name": "network-vif-deleted", "tag": "3fc5711e-92dd-43b5-bb87-aa7fabf24de6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:13 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:13 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Creating event network-vif-plugged:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:47:13 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] Creating event network-vif-deleted:3fc5711e-92dd-43b5-bb87-aa7fabf24de6 for instance ea4895e7-967c-4eda-bbc1-fe357601c5be on user Apr 20 17:47:13 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-71832025-fe73-4b90-918f-0c4a18920107 req-c0c7ceb6-5b8c-4998-bd7c-47043f149565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030741 Apr 20 17:47:13 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 78/228] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] HTTP exception thrown: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:47:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Request method failure captured: Apr 20 17:47:25 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 HTTP/1.1 Apr 20 17:47:25 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:47:25 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:47:25 user devstack@n-api.service[61866]: Connection: close Apr 20 17:47:25 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:47:25 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:47:25 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:47:25 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:47:25 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXmZTV_qJsYx0CNGLP-1hOsg984hFjBXUfliddGKuzo13xkRJSMN1hgaQEe_HxGSKdjeGO8ccDtiVMM5_wwxakxybFs6PtrOPsr9VnApHVdKVNdxByG4rsYw8solRLIQS_Fja6FDJXmCm4GCmjzwUFjFnPsvQp1vuWvpHKLkGvwPsr0 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Project-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Project-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Tenant: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Tenant-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-User: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:47:25 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:47:25 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:47:25 user devstack@n-api.service[61866]: X-User-Id: 0e87e05c599c44b3af17a42d3df1fc14 Apr 20 17:47:25 user devstack@n-api.service[61866]: X-User-Name: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:47:25 user devstack@n-api.service[61866]: method: > Apr 20 17:47:25 user devstack@n-api.service[61866]: exception: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:47:25 user devstack@n-api.service[61866]: action_args: {'id': '144ff119-1608-45ca-bd96-e648560c0a48'} Apr 20 17:47:25 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:47:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:47:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Returning 404 to user: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:47:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-957fe215-52b2-449b-94dc-60ad0bb6519f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 404 len: 111 microversion: 2.1 time: 0.038402 Apr 20 17:47:25 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:24 2023] GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=18 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:25 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-0dbe56d8-ee25-49f5-bd60-42dfe1548ad7 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1494 microversion: 2.1 time: 0.244283 Apr 20 17:47:25 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:25 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1494 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:34 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-c71a6465-0d36-4e41-a94d-3327afe3735e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 200 len: 1544 microversion: 2.1 time: 0.218728 Apr 20 17:47:34 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:34 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:37 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-7238baf0-97df-4229-8faf-5378f3c14364 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.266515 Apr 20 17:47:37 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:47:37 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b/os-interface => generated 283 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:47:37 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:37 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:37 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:37 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-f2229a9d-aba5-4d81-ad73-b2bff8a53984 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 200 len: 1692 microversion: 2.87 time: 0.499279 Apr 20 17:47:37 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 77/233] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:47:36 2023] GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 1692 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:47:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:38 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] Creating event network-changed:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:47:38 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-72be0858-813b-47a6-a5fc-053bf03099df req-e62daabc-cf5c-4ec9-8785-2e5e2f0710c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029064 Apr 20 17:47:38 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 80/234] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-27a9c512-1c1b-4e52-a24e-920d86628c1e tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b/ips" status: 200 len: 105 microversion: 2.1 time: 0.036093 Apr 20 17:47:38 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 78/235] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:47:38 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b/ips => generated 105 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:39 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:47:39 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-4047904b-f7dc-44f9-855d-d3e5364bc3b4 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 204 len: 0 microversion: 2.1 time: 0.105659 Apr 20 17:47:39 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:47:39 2023] DELETE /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "name": "network-vif-unplugged", "status": "completed", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:39 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] Creating event network-vif-unplugged:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:47:39 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-c475f14c-b095-4e60-b09b-80b0a1fa9541 req-022bf0f1-a675-494e-8675-5dd043a3a402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027749 Apr 20 17:47:39 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 79/237] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:39 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1d025cf0584fa286870d8232bceb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829829f4ef449d4a279c8a702d4c43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:39 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ff4ef2d7-f99b-4df7-b7f1-69475d6764af tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 200 len: 1663 microversion: 2.1 time: 0.442928 Apr 20 17:47:39 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:39 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 1663 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:40 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:40 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-f3085c13-b4ae-427b-98c8-4044c340c10b tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 200 len: 1536 microversion: 2.1 time: 0.245692 Apr 20 17:47:40 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 79/239] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:40 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 1536 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:41 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "name": "network-vif-plugged", "status": "completed", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}, {"server_uuid": "5fa25e21-cac6-42d3-8937-c1a836a7d12b", "name": "network-vif-deleted", "tag": "3be285a5-b6bc-4373-aef6-c2f5764415de"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:41 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Creating event network-vif-plugged:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:47:41 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] Creating event network-vif-deleted:3be285a5-b6bc-4373-aef6-c2f5764415de for instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b on user Apr 20 17:47:41 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-ce58b842-d87a-4bc0-893d-c3fc6c169eb7 req-4571ab34-8603-43a8-ad12-87341b297e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027963 Apr 20 17:47:41 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 80/240] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] [instance: a398193c-27e0-4e9f-a846-258790e2b915] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] HTTP exception thrown: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Request method failure captured: Apr 20 17:47:42 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 HTTP/1.1 Apr 20 17:47:42 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:47:42 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:47:42 user devstack@n-api.service[61867]: Connection: close Apr 20 17:47:42 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:47:42 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:47:42 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:47:42 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:47:42 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmjgI2lwyc0OSTdurUEFzk_E53R7GSZZvsDuH3rcsUeCe3EPEaC7odoK0-gC6mmjykpk1avgtP7mcJvPI2uNFl6wQ6dBiRK-GbdCAa-2LoAArObhZ5O9rKnSeFNgi7883yERlN2wPf5vbBfR7xJAJR9nYCr7ZeRlNU-tTT3MFWRFCQ Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Project-Id: 2d8b7e93a856468e831596fbf4a085bc Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Project-Name: tempest-ServerStableDeviceRescueTest-194787550 Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8b7e93a856468e831596fbf4a085bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d8b7e93a856468e831596fbf4a085bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8b7e93a856468e831596fbf4a085bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Tenant: tempest-ServerStableDeviceRescueTest-194787550 Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Tenant-Id: 2d8b7e93a856468e831596fbf4a085bc Apr 20 17:47:42 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-194787550 Apr 20 17:47:42 user devstack@n-api.service[61867]: X-User: tempest-ServerStableDeviceRescueTest-194787550-project-member Apr 20 17:47:42 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:47:42 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:47:42 user devstack@n-api.service[61867]: X-User-Id: f3c1ddc4186b4234a18271673ea42a2a Apr 20 17:47:42 user devstack@n-api.service[61867]: X-User-Name: tempest-ServerStableDeviceRescueTest-194787550-project-member Apr 20 17:47:42 user devstack@n-api.service[61867]: method: > Apr 20 17:47:42 user devstack@n-api.service[61867]: exception: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. Apr 20 17:47:42 user devstack@n-api.service[61867]: action_args: {'id': 'a398193c-27e0-4e9f-a846-258790e2b915'} Apr 20 17:47:42 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. Apr 20 17:47:42 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:47:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Returning 404 to user: Instance a398193c-27e0-4e9f-a846-258790e2b915 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:47:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-21465530-cd61-4a0e-a992-9e5449b7dd2f tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915" status: 404 len: 111 microversion: 2.1 time: 0.027546 Apr 20 17:47:42 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:42 2023] GET /compute/v2.1/servers/a398193c-27e0-4e9f-a846-258790e2b915 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:47:42 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-fddf2aa9-598b-4aad-90cf-dca76aeaf604 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] Calling method '.version_select at 0x7f342d82f520>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:42 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-fddf2aa9-598b-4aad-90cf-dca76aeaf604 tempest-ServerStableDeviceRescueTest-194787550 tempest-ServerStableDeviceRescueTest-194787550-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367701788" status: 202 len: 0 microversion: 2.1 time: 0.021441 Apr 20 17:47:42 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 80/242] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:47:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367701788 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:43 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-1b6ed3d7-4ce5-4fa7-b09b-9741f884ae5f tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.149357 Apr 20 17:47:43 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:47:43 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314/os-interface => generated 282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:44 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:47:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:44 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] Creating event network-changed:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:47:44 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-8673779f-edcc-4230-8030-6bd843ebdde9 req-87ab2026-53b3-459b-9811-be4718256cc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033017 Apr 20 17:47:44 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 83/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:44 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8b6176cc-b6c6-458d-a67f-19b8c4968b32 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1539 microversion: 2.1 time: 0.236601 Apr 20 17:47:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 81/245] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:44 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1539 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:47:44 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:47:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-b4a47e47-037d-4349-bcb9-16b55adc88b3 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1539 microversion: 2.1 time: 0.142916 Apr 20 17:47:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 82/246] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:47:44 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=10 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=18 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: ea4895e7-967c-4eda-bbc1-fe357601c5be] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:00 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] HTTP exception thrown: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Request method failure captured: Apr 20 17:48:01 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be HTTP/1.1 Apr 20 17:48:01 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:48:01 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:48:01 user devstack@n-api.service[61867]: Connection: close Apr 20 17:48:01 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:48:01 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:48:01 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:48:01 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:48:01 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmhoe12PD_0Hid-7bvvrIZCLJiSzFO1zU8jRA3LjJszK4TXH9D7Jo9mnzuzuQHh-HBVbTWRm5bvtuTdT08JlMejLtBbRNsu6w-v22eqOtjIlWpr8eTH8XwKp_J2UOroIIzecNTfzkrcaydk_5T-jnFXjGw7MlZoeog7RlryqwzEWv4 Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Project-Id: 1a7ca478c36a44189905226b0e5ffaaa Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Project-Name: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Tenant: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Tenant-Id: 1a7ca478c36a44189905226b0e5ffaaa Apr 20 17:48:01 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:01 user devstack@n-api.service[61867]: X-User: tempest-VolumesAdminNegativeTest-990238581-project-member Apr 20 17:48:01 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:48:01 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:48:01 user devstack@n-api.service[61867]: X-User-Id: 3bbaba13b37342668437a13b9eb0939b Apr 20 17:48:01 user devstack@n-api.service[61867]: X-User-Name: tempest-VolumesAdminNegativeTest-990238581-project-member Apr 20 17:48:01 user devstack@n-api.service[61867]: method: > Apr 20 17:48:01 user devstack@n-api.service[61867]: exception: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. Apr 20 17:48:01 user devstack@n-api.service[61867]: action_args: {'id': 'ea4895e7-967c-4eda-bbc1-fe357601c5be'} Apr 20 17:48:01 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. Apr 20 17:48:01 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Returning 404 to user: Instance ea4895e7-967c-4eda-bbc1-fe357601c5be could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-f969b01f-677f-4a7f-843f-8b28f59e614a tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be" status: 404 len: 111 microversion: 2.1 time: 0.037635 Apr 20 17:48:01 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:00 2023] GET /compute/v2.1/servers/ea4895e7-967c-4eda-bbc1-fe357601c5be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:48:01 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bac8cdc8-94e4-4262-9ece-3ce15d953437 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20" status: 204 len: 0 microversion: 2.1 time: 0.114425 Apr 20 17:48:01 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:48:01 2023] DELETE /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=12 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=22 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbaba13b37342668437a13b9eb0939b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7ca478c36a44189905226b0e5ffaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:01 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-57e25d87-a353-4946-b80b-6a6d4962f119 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20" status: 200 len: 1668 microversion: 2.1 time: 0.261387 Apr 20 17:48:01 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:01 2023] GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "name": "network-vif-unplugged", "status": "completed", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] Creating event network-vif-unplugged:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:48:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-00f44499-c811-4f96-9fed-e3948048555c req-de300fb6-c5d7-4a49-9812-d9c540ca9f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035341 Apr 20 17:48:01 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 85/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:03 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "name": "network-vif-plugged", "status": "completed", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}, {"server_uuid": "4d7bb67b-1b10-4291-99c4-176ebe4f0d20", "name": "network-vif-deleted", "tag": "1fb4b994-5220-427c-b482-3acd0bb45776"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:03 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Creating event network-vif-plugged:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:48:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] Creating event network-vif-deleted:1fb4b994-5220-427c-b482-3acd0bb45776 for instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 on user Apr 20 17:48:03 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-29ea9bb8-ff50-4ead-bccf-92ec88d37668 req-f49e624e-cc56-407e-af4e-6028d38946bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.140988 Apr 20 17:48:03 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:27 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:27 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8facdc14-755f-42ed-b436-4cad0f888db5 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1494 microversion: 2.1 time: 0.218477 Apr 20 17:48:27 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 84/252] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:26 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1494 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:30 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:48:30 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b HTTP/1.1 Apr 20 17:48:30 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:48:30 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:48:30 user devstack@n-api.service[61867]: Connection: close Apr 20 17:48:30 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:48:30 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:48:30 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:48:30 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:48:30 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:30 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:30 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:30 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:48:30 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:48:30 user devstack@n-api.service[61867]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:48:30 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:30 user devstack@n-api.service[61867]: method: > Apr 20 17:48:30 user devstack@n-api.service[61867]: exception: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:30 user devstack@n-api.service[61867]: action_args: {'id': '5fa25e21-cac6-42d3-8937-c1a836a7d12b'} Apr 20 17:48:30 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:30 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:30 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:30 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d79aa205-e8fe-41b2-8cdb-96a4f36aad46 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 404 len: 111 microversion: 2.1 time: 0.424687 Apr 20 17:48:30 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:30 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 111 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:30 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:30 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:30 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-954d74c1-fe93-4f11-8ec6-9ed889017660 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '.version_select at 0x7f342d82f250>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:30 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-954d74c1-fe93-4f11-8ec6-9ed889017660 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104029701" status: 202 len: 0 microversion: 2.1 time: 0.030030 Apr 20 17:48:30 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:48:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104029701 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:31 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:48:31 user devstack@n-api.service[61868]: request: DELETE /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b HTTP/1.1 Apr 20 17:48:31 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:48:31 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:48:31 user devstack@n-api.service[61868]: Connection: close Apr 20 17:48:31 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:48:31 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:48:31 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:48:31 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:48:31 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:31 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:31 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:48:31 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:48:31 user devstack@n-api.service[61868]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:48:31 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:31 user devstack@n-api.service[61868]: method: > Apr 20 17:48:31 user devstack@n-api.service[61868]: exception: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61868]: action_args: {'id': '5fa25e21-cac6-42d3-8937-c1a836a7d12b'} Apr 20 17:48:31 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:31 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-323dd7ad-61e2-40b4-afb2-7a8436565ae0 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 404 len: 111 microversion: 2.1 time: 0.029191 Apr 20 17:48:31 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:48:31 2023] DELETE /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 5fa25e21-cac6-42d3-8937-c1a836a7d12b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:48:31 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b HTTP/1.1 Apr 20 17:48:31 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:48:31 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:48:31 user devstack@n-api.service[61867]: Connection: close Apr 20 17:48:31 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:48:31 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:48:31 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:48:31 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:48:31 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:31 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:31 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:31 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:48:31 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:48:31 user devstack@n-api.service[61867]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:48:31 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:31 user devstack@n-api.service[61867]: method: > Apr 20 17:48:31 user devstack@n-api.service[61867]: exception: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61867]: action_args: {'id': '5fa25e21-cac6-42d3-8937-c1a836a7d12b'} Apr 20 17:48:31 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. Apr 20 17:48:31 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:48:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 5fa25e21-cac6-42d3-8937-c1a836a7d12b could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-9a3935a7-6327-41a5-9761-81ad63e1f306 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b" status: 404 len: 111 microversion: 2.1 time: 0.030377 Apr 20 17:48:31 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:31 2023] GET /compute/v2.1/servers/5fa25e21-cac6-42d3-8937-c1a836a7d12b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:48:32 user devstack@n-api.service[61866]: request: DELETE /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f HTTP/1.1 Apr 20 17:48:32 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:48:32 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:48:32 user devstack@n-api.service[61866]: Connection: close Apr 20 17:48:32 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:48:32 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:48:32 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:48:32 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:48:32 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:32 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:32 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:48:32 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:48:32 user devstack@n-api.service[61866]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:48:32 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:32 user devstack@n-api.service[61866]: method: > Apr 20 17:48:32 user devstack@n-api.service[61866]: exception: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61866]: action_args: {'id': '6f5ee5ac-ed9d-4d68-946f-7844b6432d7f'} Apr 20 17:48:32 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-4503ebbf-0235-4532-9e5a-0c66443fb9f9 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 404 len: 111 microversion: 2.1 time: 0.028139 Apr 20 17:48:32 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:48:31 2023] DELETE /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] [instance: 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] HTTP exception thrown: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Request method failure captured: Apr 20 17:48:32 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f HTTP/1.1 Apr 20 17:48:32 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:48:32 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:48:32 user devstack@n-api.service[61868]: Connection: close Apr 20 17:48:32 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:48:32 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:48:32 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:48:32 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:48:32 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmZ3r89Jx9m11_MNonkoWrHf_Anwj3UkqX4JZg2-Xc7YZE2xSwNPX82L7YNY0VL4nTQePAgN8i0cLZUi9nludC_F7rrdJPz9KOAdyuPShpsvCLO6Zo5JhNqWzdLibczjg8Ud1EDM3MaSJPEbAl_iqLQbTo2ucNEBMmzSXIhy2gQcaw Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Project-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d829829f4ef449d4a279c8a702d4c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Tenant-Id: d829829f4ef449d4a279c8a702d4c43f Apr 20 17:48:32 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1956591695 Apr 20 17:48:32 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:32 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:48:32 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:48:32 user devstack@n-api.service[61868]: X-User-Id: 7b1d025cf0584fa286870d8232bceb97 Apr 20 17:48:32 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeTestJSON-1956591695-project-member Apr 20 17:48:32 user devstack@n-api.service[61868]: method: > Apr 20 17:48:32 user devstack@n-api.service[61868]: exception: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61868]: action_args: {'id': '6f5ee5ac-ed9d-4d68-946f-7844b6432d7f'} Apr 20 17:48:32 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. Apr 20 17:48:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] Returning 404 to user: Instance 6f5ee5ac-ed9d-4d68-946f-7844b6432d7f could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-d50414d3-0a0d-4dd5-9648-7594f6184968 tempest-AttachVolumeTestJSON-1956591695 tempest-AttachVolumeTestJSON-1956591695-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f" status: 404 len: 111 microversion: 2.1 time: 0.031144 Apr 20 17:48:32 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 86/258] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:32 2023] GET /compute/v2.1/servers/6f5ee5ac-ed9d-4d68-946f-7844b6432d7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-101d93aa-36c0-4d2d-91af-b058b5863f6e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.158491 Apr 20 17:48:34 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 88/259] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:48:34 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b/os-interface => generated 282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:35 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-90cd20ed-9117-404c-964e-ef6cd3f4ff01 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.544914 Apr 20 17:48:35 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:34 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-13c56c68-7f07-4b6e-83ec-0c133935730d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.225821 Apr 20 17:48:35 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:35 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:35 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] Creating event network-changed:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:48:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-f4f09ef5-0215-43b1-ab53-3447e9d9ed0e req-15fefceb-d44e-4c7a-936b-95af4860f20a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029338 Apr 20 17:48:35 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 89/262] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:35 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e86daec6-6267-44c0-8467-5fad7f3519c2 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b/ips" status: 200 len: 108 microversion: 2.1 time: 0.035987 Apr 20 17:48:35 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:48:35 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Going to try to terminate instance {{(pid=61868) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:48:37 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-099c688a-20b5-46bb-84c8-17ac0c563317 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 204 len: 0 microversion: 2.1 time: 0.112752 Apr 20 17:48:37 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:48:37 2023] DELETE /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1345352294"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:37 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:37 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-7e197dca-cd08-40f5-9d3c-ab3ab2ad1d5d tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 200 len: 1669 microversion: 2.1 time: 0.473966 Apr 20 17:48:37 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:37 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 1669 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "name": "network-vif-unplugged", "status": "completed", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] Creating event network-vif-unplugged:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:48:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-b928c76a-3264-404f-9ad3-49db3324b9b1 req-ca0c84b6-57b7-459d-a8bf-0f3d433e2185 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141652 Apr 20 17:48:38 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:38 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-22c87208-b183-4d2b-aaed-472988b03560 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150/action" status: 202 len: 52 microversion: 2.87 time: 0.841365 Apr 20 17:48:38 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 90/267] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 17:48:37 2023] POST /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150/action => generated 52 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 17:48:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "name": "network-vif-deleted", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:39 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] Creating event network-vif-deleted:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:48:39 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-57cfe780-1b39-47c1-8791-706427a18761 req-c8abd4d8-d311-4806-a4e5-634d770a8e13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039279 Apr 20 17:48:39 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:40 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bdbb76-a7bd-4a1e-90a8-1994016bff4b", "name": "network-vif-plugged", "status": "completed", "tag": "71111de9-9def-4cb3-89de-988e587ed2ca"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:40 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] Creating event network-vif-plugged:71111de9-9def-4cb3-89de-988e587ed2ca for instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b on user Apr 20 17:48:40 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-b3380f64-6c10-446a-93d3-f869cd3796ed req-10a13ab9-5941-443b-8c06-806036869c32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Apr 20 17:48:40 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 90/269] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:40 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:40 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:41 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-486539c1-640e-4c95-8e0c-0311a1592c6e tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 200 len: 1536 microversion: 2.1 time: 0.329041 Apr 20 17:48:41 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 91/270] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:40 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 1536 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Searching by: {'deleted': False, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b'} {{(pid=61866) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61866]: DEBUG nova.compute.multi_cell_list [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 17:48:41 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5f0a6788-a4a4-4660-aa24-ec5c9d0d896f tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.197205 Apr 20 17:48:41 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 90/271] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 17:48:41 2023] GET /compute/v2.1/servers => generated 340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:41 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:41 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-02e5a8f4-6dbe-4771-8ce0-bfe7ce9332cd tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 200 len: 1536 microversion: 2.1 time: 0.225499 Apr 20 17:48:41 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 91/272] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:41 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 1536 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:48:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bad7cca3-a8b2-4374-a652-c30e9beb0ea1 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 204 len: 0 microversion: 2.1 time: 0.106368 Apr 20 17:48:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:48:43 2023] DELETE /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfeb17aa1177414ea2f2a8dc310670b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b4fb65c2cd4247906c8211fa5bc56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:43 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-9c003770-da90-4ac8-8d95-f5b39b517abf tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 200 len: 1542 microversion: 2.1 time: 0.314179 Apr 20 17:48:43 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 91/274] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:43 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 1542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "name": "network-vif-unplugged", "status": "completed", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] Creating event network-vif-unplugged:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:48:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-cf8b63c0-11ef-4048-bb8a-a9595217e7ef req-c7221793-053e-45cc-8721-f3961100b850 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201643 Apr 20 17:48:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:43 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:48:43 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-4e910a20-6983-48e3-9c57-3445f4f7de72 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 200 len: 1692 microversion: 2.87 time: 0.453539 Apr 20 17:48:43 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 92/276] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:48:43 2023] GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 1692 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:48:44 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "name": "network-vif-deleted", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:44 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] Creating event network-vif-deleted:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:48:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-6fb5d296-e06d-4280-8a52-fae3efde4ebe req-7ea05b9d-c067-4438-a79b-e0909b933251 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035689 Apr 20 17:48:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 92/277] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:45 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38458948-e0ee-4767-814f-36e02b5de61c", "name": "network-vif-plugged", "status": "completed", "tag": "13e66833-d98c-4c20-84da-accbe7d4ac57"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:48:45 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:45 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:45 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:45 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] Creating event network-vif-plugged:13e66833-d98c-4c20-84da-accbe7d4ac57 for instance 38458948-e0ee-4767-814f-36e02b5de61c on user Apr 20 17:48:45 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-8eee1e93-8efa-4f0b-b037-9629423ad4da req-8c6a335f-085c-4da9-a32c-4488c12a6435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 Apr 20 17:48:45 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 94/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] [instance: 4d7bb67b-1b10-4291-99c4-176ebe4f0d20] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:48:51 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] HTTP exception thrown: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Request method failure captured: Apr 20 17:48:51 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 HTTP/1.1 Apr 20 17:48:51 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:48:51 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:48:51 user devstack@n-api.service[61868]: Connection: close Apr 20 17:48:51 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:48:51 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:48:51 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:48:51 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:48:51 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmhoe12PD_0Hid-7bvvrIZCLJiSzFO1zU8jRA3LjJszK4TXH9D7Jo9mnzuzuQHh-HBVbTWRm5bvtuTdT08JlMejLtBbRNsu6w-v22eqOtjIlWpr8eTH8XwKp_J2UOroIIzecNTfzkrcaydk_5T-jnFXjGw7MlZoeog7RlryqwzEWv4 Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Project-Id: 1a7ca478c36a44189905226b0e5ffaaa Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Project-Name: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7ca478c36a44189905226b0e5ffaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Tenant: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Tenant-Id: 1a7ca478c36a44189905226b0e5ffaaa Apr 20 17:48:51 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-990238581 Apr 20 17:48:51 user devstack@n-api.service[61868]: X-User: tempest-VolumesAdminNegativeTest-990238581-project-member Apr 20 17:48:51 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:48:51 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:48:51 user devstack@n-api.service[61868]: X-User-Id: 3bbaba13b37342668437a13b9eb0939b Apr 20 17:48:51 user devstack@n-api.service[61868]: X-User-Name: tempest-VolumesAdminNegativeTest-990238581-project-member Apr 20 17:48:51 user devstack@n-api.service[61868]: method: > Apr 20 17:48:51 user devstack@n-api.service[61868]: exception: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. Apr 20 17:48:51 user devstack@n-api.service[61868]: action_args: {'id': '4d7bb67b-1b10-4291-99c4-176ebe4f0d20'} Apr 20 17:48:51 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. Apr 20 17:48:51 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:48:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Returning 404 to user: Instance 4d7bb67b-1b10-4291-99c4-176ebe4f0d20 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:48:51 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-9ba9edb7-7719-4764-9f3f-316bd754b37f tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20" status: 404 len: 111 microversion: 2.1 time: 0.219136 Apr 20 17:48:51 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 93/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:48:51 2023] GET /compute/v2.1/servers/4d7bb67b-1b10-4291-99c4-176ebe4f0d20 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:48:51 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:48:51 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c5ffb4e7-1173-48fc-bac3-91d71fc62391 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] Calling method '.version_select at 0x7f342d82fb50>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:48:51 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c5ffb4e7-1173-48fc-bac3-91d71fc62391 tempest-VolumesAdminNegativeTest-990238581 tempest-VolumesAdminNegativeTest-990238581-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794500022" status: 202 len: 0 microversion: 2.1 time: 0.024073 Apr 20 17:48:51 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 93/280] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:48:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794500022 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:49:08 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:08 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:08 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2086102095", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:08 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] validate_networks() for [('1d8a3387-2cb5-4e26-8007-1214d7470f60', None, None, None, None, None)] {{(pid=61867) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Flavor limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Image limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Flavor pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Image pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Getting quotas for project 49db491e5f6840e5813a5c6f5444bcc3. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Getting quotas for user 67028dfc02dc439b9aef77327a424409 and project 49db491e5f6840e5813a5c6f5444bcc3. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Going to run 1 instances... {{(pid=61867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:49:09 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:49:09 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-e5ec5c4e-28f9-4f98-ab4f-c15bed59712b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.882201 Apr 20 17:49:09 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 95/281] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:49:08 2023] POST /compute/v2.1/servers => generated 381 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:49:09 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-c77fdd9e-3821-4fa3-b700-d61047ec0c3d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:09 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-c77fdd9e-3821-4fa3-b700-d61047ec0c3d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:09 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:09 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:09 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-c77fdd9e-3821-4fa3-b700-d61047ec0c3d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:09 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-c77fdd9e-3821-4fa3-b700-d61047ec0c3d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6" status: 200 len: 1216 microversion: 2.1 time: 0.084843 Apr 20 17:49:09 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:09 2023] GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:49:09 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=36 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:09 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:09 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1423997224", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:09 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] validate_networks() for [('1d8a3387-2cb5-4e26-8007-1214d7470f60', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Getting quotas for project 49db491e5f6840e5813a5c6f5444bcc3. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Getting quotas for user 67028dfc02dc439b9aef77327a424409 and project 49db491e5f6840e5813a5c6f5444bcc3. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:49:10 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:49:10 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c5eb5095-2a62-4cc7-bcd4-8790b4857781 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.721720 Apr 20 17:49:10 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 94/283] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:49:09 2023] POST /compute/v2.1/servers => generated 381 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 20 17:49:10 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-bff962f2-a777-4be9-abc7-de3b8380db3b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:10 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-bff962f2-a777-4be9-abc7-de3b8380db3b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:10 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-bff962f2-a777-4be9-abc7-de3b8380db3b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:10 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-bff962f2-a777-4be9-abc7-de3b8380db3b tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 200 len: 1216 microversion: 2.1 time: 0.063588 Apr 20 17:49:10 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:10 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:49:13 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:13 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:13 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:13 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:13 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] Creating event network-changed:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:49:13 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-9185ea50-b3c2-48f1-9ffa-4114088ff010 req-afd97a85-e0e5-4104-b4b8-7be0687e93f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028003 Apr 20 17:49:13 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 95/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:15 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] Creating event network-changed:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:49:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-7702575c-8a61-4a0b-8bbb-c99e2d8ed88d req-71355b91-9bb0-4bf8-b18a-a15b352986ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030283 Apr 20 17:49:15 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 95/286] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:49:17 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "name": "network-vif-plugged", "status": "completed", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}, {"server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "name": "network-vif-plugged", "status": "completed", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}, {"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}, {"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Creating event network-vif-plugged:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:49:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Creating event network-vif-plugged:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:49:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:49:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:49:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-23aa599d-9ff5-48c7-ba36-c0127fdfe340 req-3ecf600f-6528-4811-a5ef-daba6781e6fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034491 Apr 20 17:49:17 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:17 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:27 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:27 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-02341c02-f173-4e72-b725-99ac1e57716d tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1494 microversion: 2.1 time: 0.224181 Apr 20 17:49:27 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 96/288] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:27 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1494 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:49:27 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:27 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:28 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:49:28 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b HTTP/1.1 Apr 20 17:49:28 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:49:28 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:49:28 user devstack@n-api.service[61866]: Connection: close Apr 20 17:49:28 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:49:28 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:49:28 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:49:28 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:49:28 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:49:28 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:49:28 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:49:28 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:49:28 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:49:28 user devstack@n-api.service[61866]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:49:28 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:49:28 user devstack@n-api.service[61866]: method: > Apr 20 17:49:28 user devstack@n-api.service[61866]: exception: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:49:28 user devstack@n-api.service[61866]: action_args: {'id': 'a6bdbb76-a7bd-4a1e-90a8-1994016bff4b'} Apr 20 17:49:28 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:49:28 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:49:28 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:49:28 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c6a1d4c5-68ce-469b-94ac-fc93dbba28fb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 404 len: 111 microversion: 2.1 time: 0.237950 Apr 20 17:49:28 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 96/289] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:27 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:49:28 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-eff4c302-9f46-4d0a-9971-ccdecc0857f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '.version_select at 0x7f342d8cde10>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:28 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:28 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=8 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:28 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:28 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:28 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-eff4c302-9f46-4d0a-9971-ccdecc0857f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340400566" status: 202 len: 0 microversion: 2.1 time: 0.029948 Apr 20 17:49:28 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:49:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340400566 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:49:28 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-d843b0bd-731e-4165-9b85-a6a2bd6b2ff7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: .version_select at 0x7f342d8936d0>, body: {"keypair": {"name": "tempest-keypair-597213983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJYmMyCTQ7pSR0ISLscbcJZ8QRQRsUO5bqcBhVKBpCVApoUmWKzjun54OI9gg+GtlxSb/nlVBWq6bx9hmceX41U2h2bR1awwTazhsYjtpCYLcOZhiGLnEycS5NDQ37hIg=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:28 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-d843b0bd-731e-4165-9b85-a6a2bd6b2ff7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:49:28 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-d843b0bd-731e-4165-9b85-a6a2bd6b2ff7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:49:29 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-d843b0bd-731e-4165-9b85-a6a2bd6b2ff7 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046655 Apr 20 17:49:29 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 97/291] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 17:49:28 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:30 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-903894628", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "81717015-dd1b-405e-b3be-87c2e48c6e76"}], "security_groups": [{"name": "tempest-securitygroup--120346789"}], "key_name": "tempest-keypair-597213983", "user_data": "}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:30 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] validate_networks() for [('81717015-dd1b-405e-b3be-87c2e48c6e76', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Getting quotas for user 5962a317ea0249c7a8154bccbdf218ae and project b4bf3cb544974390875631ccb3d66e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:49:31 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:49:31 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-5e785026-6637-4d5d-9f95-fed919c9e433 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.705663 Apr 20 17:49:31 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 97/292] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:49:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:49:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ce213d0c-d5fc-49ba-99c8-591788782eab tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:31 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ce213d0c-d5fc-49ba-99c8-591788782eab tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:31 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ce213d0c-d5fc-49ba-99c8-591788782eab tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ce213d0c-d5fc-49ba-99c8-591788782eab tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 200 len: 1234 microversion: 2.1 time: 0.085721 Apr 20 17:49:31 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:31 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] [instance: 38458948-e0ee-4767-814f-36e02b5de61c] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:33 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] HTTP exception thrown: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Request method failure captured: Apr 20 17:49:33 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c HTTP/1.1 Apr 20 17:49:33 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:49:33 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:49:33 user devstack@n-api.service[61868]: Connection: close Apr 20 17:49:33 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:49:33 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:49:33 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:49:33 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:49:33 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXnXvJuaAnltnaE0pHF2OGRxCxku1YYLsg8kfyQ4zoTAtiLJqvgXFDtIDb9fEWSx-omezKktPp4GXaMavJ4j_RD9BwLoOe3UjUulWre4fKqquZnC0DU9pRuX9rXuFg432uJTjR85wF1n6hUsUjUXL9GSs04JJyew4NITTmRXyG46E7w Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Project-Id: a9b4fb65c2cd4247906c8211fa5bc56b Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Project-Name: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9b4fb65c2cd4247906c8211fa5bc56b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Tenant: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Tenant-Id: a9b4fb65c2cd4247906c8211fa5bc56b Apr 20 17:49:33 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-907639887 Apr 20 17:49:33 user devstack@n-api.service[61868]: X-User: tempest-TestMinimumBasicScenario-907639887-project-member Apr 20 17:49:33 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:49:33 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:49:33 user devstack@n-api.service[61868]: X-User-Id: bfeb17aa1177414ea2f2a8dc310670b4 Apr 20 17:49:33 user devstack@n-api.service[61868]: X-User-Name: tempest-TestMinimumBasicScenario-907639887-project-member Apr 20 17:49:33 user devstack@n-api.service[61868]: method: > Apr 20 17:49:33 user devstack@n-api.service[61868]: exception: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. Apr 20 17:49:33 user devstack@n-api.service[61868]: action_args: {'id': '38458948-e0ee-4767-814f-36e02b5de61c'} Apr 20 17:49:33 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. Apr 20 17:49:33 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:49:33 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Returning 404 to user: Instance 38458948-e0ee-4767-814f-36e02b5de61c could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:49:33 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-f475cb36-b3a0-4e06-97db-e3c44ece26d8 tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c" status: 404 len: 111 microversion: 2.1 time: 0.129981 Apr 20 17:49:33 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:33 2023] GET /compute/v2.1/servers/38458948-e0ee-4767-814f-36e02b5de61c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:49:33 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-48191b9f-416f-485d-ac4b-363da591127d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] Calling method '.version_select at 0x7f342ee42e60>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:33 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-48191b9f-416f-485d-ac4b-363da591127d tempest-TestMinimumBasicScenario-907639887 tempest-TestMinimumBasicScenario-907639887-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1985986764" status: 202 len: 0 microversion: 2.1 time: 0.021121 Apr 20 17:49:33 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 98/295] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 17:49:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1985986764 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:49:34 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:34 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] Creating event network-changed:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:49:34 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-e0389424-f8f3-4f94-8aee-2f9b0450728b req-e076d4df-ee6a-437f-b8f8-0b76d2bb1fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027124 Apr 20 17:49:34 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 100/296] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:49:36 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "name": "network-vif-plugged", "status": "completed", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:36 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:36 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] Creating event network-vif-plugged:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:49:36 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-d36e9557-523d-4eba-b5d9-4b64f5b4356a req-e553e41b-4658-437b-b30f-9ca59eedff61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030238 Apr 20 17:49:36 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:37 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:37 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-80900775-6e71-413d-bc8d-ad4cfb6cecae tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.376400 Apr 20 17:49:37 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:49:37 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:49:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "name": "network-vif-plugged", "status": "completed", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:39 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] Creating event network-vif-plugged:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:49:39 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-ab94bd89-3504-4234-99ba-d690f32b11a7 req-955319d0-4c8f-4d18-8079-4454e7558dc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028782 Apr 20 17:49:39 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 101/299] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2076134083", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "699d9e3b-82b5-48ec-913e-e64620fd3440"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] validate_networks() for [('699d9e3b-82b5-48ec-913e-e64620fd3440', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for user 33fc090f5bc6478a958614985155d7f1 and project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:49:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:49:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-7f3b2bdb-64bc-4137-8bab-408436e29f20 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.673821 Apr 20 17:49:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 100/300] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:49:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:44 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:49:44 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a6bc7430-d273-4fce-8b13-be761e5180fe tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4" status: 200 len: 1395 microversion: 2.87 time: 0.116355 Apr 20 17:49:44 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 100/301] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:49:44 2023] GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4 => generated 1395 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:49:47 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:49:47 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5774e71-ff8f-49ed-b318-049762a09ff4", "tag": "f51871c4-339b-4e00-a204-5067223a0c4a"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:47 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:47 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] Creating event network-changed:f51871c4-339b-4e00-a204-5067223a0c4a for instance a5774e71-ff8f-49ed-b318-049762a09ff4 on user Apr 20 17:49:47 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-5290efbb-5443-4554-8b12-ed39eea3ebd7 req-04021c6f-b972-453d-bea8-9a9b466ec624 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031346 Apr 20 17:49:47 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:49:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5774e71-ff8f-49ed-b318-049762a09ff4", "name": "network-vif-deleted", "tag": "f51871c4-339b-4e00-a204-5067223a0c4a"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:49:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:49:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:49:52 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:49:52 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.compute.server_external_events [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] Unable to find a host for instance a5774e71-ff8f-49ed-b318-049762a09ff4. Dropping event network-vif-deleted {{(pid=61868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 17:49:52 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-bc5a8d02-d58c-48f2-8fe4-9440ec5fd789 req-6652e8ab-6224-4f6f-8545-4c6881ffa628 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.025230 Apr 20 17:49:52 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:49:52 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=10 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:00 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:00 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-4f7556b0-7639-41b6-822f-72d410ea71a6 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 200 len: 1505 microversion: 2.1 time: 0.239360 Apr 20 17:50:00 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:00 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:21 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-0a0a87a6-edd2-48f2-ab4e-1a376ecd3893 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 200 len: 1544 microversion: 2.1 time: 0.232533 Apr 20 17:50:21 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:21 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=14 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:28 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8b61b805-1553-4bfd-8ccf-b0787d4f49ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1494 microversion: 2.1 time: 0.239071 Apr 20 17:50:28 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:28 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:34 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.objects.instance [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lazy-loading 'fault' on Instance uuid a5774e71-ff8f-49ed-b318-049762a09ff4 {{(pid=61866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:35 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bb103eae-fc95-4330-a661-a3d97e144dcb tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4" status: 200 len: 1650 microversion: 2.87 time: 0.116362 Apr 20 17:50:35 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 102/307] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:50:34 2023] GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4 => generated 1650 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Doing local delete in cell 1f878406-f865-4f02-bb10-aa57d0aa28b3(cell1) {{(pid=61867) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61867]: WARNING nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] instance's host None is down, deleting from database Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] deallocate_for_instance() {{(pid=61867) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Instance cache missing network info. {{(pid=61867) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Updating instance_info_cache with network_info: [] {{(pid=61867) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 17:50:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61867) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 17:50:35 user devstack@n-api.service[61867]: WARNING nova.compute.api [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 17:50:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ceb5eb1f-13c3-489e-8891-45e730031db2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4" status: 204 len: 0 microversion: 2.87 time: 0.559861 Apr 20 17:50:35 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 104/308] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 17:50:35 2023] DELETE /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: a5774e71-ff8f-49ed-b318-049762a09ff4] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] HTTP exception thrown: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Request method failure captured: Apr 20 17:50:35 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4 HTTP/1.1 Apr 20 17:50:35 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:50:35 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:50:35 user devstack@n-api.service[61868]: Connection: close Apr 20 17:50:35 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:50:35 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:50:35 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:50:35 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:50:35 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXqFOylYGTLxqAZ8lFGlf-eCanX2Z9qzUyUApX-Du8FTj4w2ACy--W-_d9jDiiJy4F4ULbY5F9AX-Y2ZSHFFuUzUNWGR8PKQpG8ggEBGnjDx4IXuM54jDmInT8_PHkYiAgR4DO3nvaeC3IhNUw3Dbf9WEzk02lYs9G3c2pr54DsmcKk Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Project-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Tenant-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:50:35 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-User: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:50:35 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:50:35 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:50:35 user devstack@n-api.service[61868]: X-User-Id: 33fc090f5bc6478a958614985155d7f1 Apr 20 17:50:35 user devstack@n-api.service[61868]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:50:35 user devstack@n-api.service[61868]: method: > Apr 20 17:50:35 user devstack@n-api.service[61868]: exception: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. Apr 20 17:50:35 user devstack@n-api.service[61868]: action_args: {'id': 'a5774e71-ff8f-49ed-b318-049762a09ff4'} Apr 20 17:50:35 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. Apr 20 17:50:35 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:50:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Returning 404 to user: Instance a5774e71-ff8f-49ed-b318-049762a09ff4 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:50:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-36941f30-838e-47e9-a664-082616a2a0e6 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4" status: 404 len: 111 microversion: 2.87 time: 0.027221 Apr 20 17:50:35 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 103/309] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:50:35 2023] GET /compute/v2.1/servers/a5774e71-ff8f-49ed-b318-049762a09ff4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-93107811", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "699d9e3b-82b5-48ec-913e-e64620fd3440"}]}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:50:35 user devstack@n-api.service[61866]: DEBUG nova.network.neutron [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] validate_networks() for [('699d9e3b-82b5-48ec-913e-e64620fd3440', None, None, None, None, None)] {{(pid=61866) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image limits 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image pref 0:0:0 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.virt.hardware [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.quota [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for user 33fc090f5bc6478a958614985155d7f1 and project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Going to run 1 instances... {{(pid=61866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:50:36 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:50:36 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-30d8053b-822b-471a-b55b-1409c878d9fc tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.624532 Apr 20 17:50:36 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 103/310] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:50:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:50:36 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:36 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:36 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:36 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:36 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:36 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ab1fe578-b9b2-4342-87de-a3f33416c1d0 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 200 len: 1393 microversion: 2.87 time: 0.071888 Apr 20 17:50:36 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 105/311] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:50:36 2023] GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 1393 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:37 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:37 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-a75f6a14-3d5a-4f9a-bf3d-9a236cf29e13 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.226506 Apr 20 17:50:37 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 104/312] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:37 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:37 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:38 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:38 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-cc89a845-3193-4f08-8ff5-8c6b6db840cd tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.396178 Apr 20 17:50:38 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 104/313] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:37 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:38 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:39 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:50:39 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-c6e49c13-7146-4158-8206-d14e84e57be2 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.841929 Apr 20 17:50:39 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:50:38 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:50:39 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:50:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:39 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:39 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] Creating event network-changed:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:50:39 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-27a07fad-f325-48f6-9e97-1c5571ef4a07 req-a2ccadaf-6ce4-4e88-8822-c5e5dc4dd86d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Apr 20 17:50:39 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 105/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:50:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:50:41 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "name": "network-vif-plugged", "status": "completed", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:50:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:41 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] Creating event network-vif-plugged:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:50:41 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-8e5a2c8f-aae9-4a4d-ac0e-29fe14be9e02 req-9820f34f-7e17-4021-96d5-d20fccaf6ffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034991 Apr 20 17:50:41 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:50:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:50:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "name": "network-vif-plugged", "status": "completed", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:50:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:50:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:50:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:50:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] Creating event network-vif-plugged:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:50:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-b7c3a224-5768-412f-b4d6-034af964b4d8 req-c8b777ef-a4d2-41fe-90db-bc49d07e9dbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028740 Apr 20 17:50:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 107/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=8 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=16 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:00 user devstack@n-api.service[61868]: DEBUG nova.objects.instance [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lazy-loading 'flavor' on Instance uuid 497b466e-8586-4847-bb74-4e9337a20a5d {{(pid=61868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 17:51:00 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-ff1a67c9-2e4a-472a-8235-ddd38915625f tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d/action" status: 200 len: 32 microversion: 2.1 time: 0.164732 Apr 20 17:51:00 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 106/318] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 17:51:00 2023] POST /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=18 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:00 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:01 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:01 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8e6ffdc4-28dd-4a3a-ad3c-91335935329d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 200 len: 1511 microversion: 2.1 time: 0.265816 Apr 20 17:51:01 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:00 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:01 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] Creating event network-vif-unplugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:51:01 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-6b3e7f0e-9d44-4244-95cd-53c893e994b3 req-bf09121b-fec5-4773-bf0c-ce4d43457be0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048694 Apr 20 17:51:01 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 108/320] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:03 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:03 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:51:03 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-ba15ac03-38e3-437d-9d8b-b82cb8a409cc req-1cffb647-f45d-4647-8996-e946780e32f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042872 Apr 20 17:51:03 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 107/321] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:05 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}, {"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:05 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:05 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:51:05 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:51:05 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-5011fd3d-a3d7-4131-93b3-e285d0aa44b7 req-972f1673-8a4c-4c5a-b163-a1d827974ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030920 Apr 20 17:51:05 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 107/322] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:22 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ad812839-04a7-4756-93be-443e7e0f58cb tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.177880 Apr 20 17:51:22 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 17:51:21 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61/os-interface => generated 283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:22 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:22 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] Creating event network-changed:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:51:22 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-dceb6c0d-d8e7-4184-86a8-f514e3d31295 req-ed152e33-5a42-434c-acdd-dd598e9d5a7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038810 Apr 20 17:51:22 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 108/324] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=8 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:22 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:22 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-6e586581-0762-40bf-87d7-df2c8503d68e tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61/ips" status: 200 len: 109 microversion: 2.1 time: 0.047606 Apr 20 17:51:22 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:51:22 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61/ips => generated 109 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:24 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:51:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-2bc7a621-0d59-432d-b1c8-ef0e1456f0aa tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 204 len: 0 microversion: 2.1 time: 0.121528 Apr 20 17:51:24 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:51:24 2023] DELETE /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "name": "network-vif-unplugged", "status": "completed", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:24 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] Creating event network-vif-unplugged:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:51:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-46158fb0-9f0a-4f96-a85b-466b0d3a2682 req-41d16958-b2a1-45a1-acad-6d6436704a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033310 Apr 20 17:51:24 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 109/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:51:24 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5962a317ea0249c7a8154bccbdf218ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bf3cb544974390875631ccb3d66e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-08ea9c77-342c-4270-bf13-e6b738435a8c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 200 len: 1669 microversion: 2.1 time: 0.451660 Apr 20 17:51:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 109/328] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:24 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:51:25 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "name": "network-vif-deleted", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:25 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] Creating event network-vif-deleted:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:51:25 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-39f9640b-62be-4122-a0b0-ce80be3415e3 req-efa42481-dfd4-4757-81e0-1448bbd258d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032957 Apr 20 17:51:25 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:26 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1954c1-b2db-4ff0-b387-24efe8b5db61", "name": "network-vif-plugged", "status": "completed", "tag": "e45dec9e-214e-4f7f-8b82-3eab75731f8a"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:26 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] Creating event network-vif-plugged:e45dec9e-214e-4f7f-8b82-3eab75731f8a for instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 on user Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:26 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:26 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-2286942a-46de-4069-b8c0-acb28551d282 req-8764812f-3171-4a21-8970-9110254eecdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031677 Apr 20 17:51:26 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 110/330] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:26 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-995f2efc-a364-4a0e-8f34-d6685ccdbbd2 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 200 len: 1690 microversion: 2.87 time: 0.248016 Apr 20 17:51:26 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 110/331] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:51:26 2023] GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] HTTP exception thrown: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Request method failure captured: Apr 20 17:51:29 user devstack@n-api.service[61867]: request: DELETE /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 HTTP/1.1 Apr 20 17:51:29 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:51:29 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:51:29 user devstack@n-api.service[61867]: Connection: close Apr 20 17:51:29 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:51:29 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:51:29 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:51:29 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:51:29 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXmZTV_qJsYx0CNGLP-1hOsg984hFjBXUfliddGKuzo13xkRJSMN1hgaQEe_HxGSKdjeGO8ccDtiVMM5_wwxakxybFs6PtrOPsr9VnApHVdKVNdxByG4rsYw8solRLIQS_Fja6FDJXmCm4GCmjzwUFjFnPsvQp1vuWvpHKLkGvwPsr0 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Project-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Project-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Tenant: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Tenant-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-User: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:51:29 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:51:29 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:51:29 user devstack@n-api.service[61867]: X-User-Id: 0e87e05c599c44b3af17a42d3df1fc14 Apr 20 17:51:29 user devstack@n-api.service[61867]: X-User-Name: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:51:29 user devstack@n-api.service[61867]: method: > Apr 20 17:51:29 user devstack@n-api.service[61867]: exception: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61867]: action_args: {'id': '144ff119-1608-45ca-bd96-e648560c0a48'} Apr 20 17:51:29 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Returning 404 to user: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:51:29 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-013a7e4f-804e-4375-bc04-a1953d8d3278 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 404 len: 111 microversion: 2.1 time: 0.033032 Apr 20 17:51:29 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:51:29 2023] DELETE /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 144ff119-1608-45ca-bd96-e648560c0a48] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] HTTP exception thrown: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Request method failure captured: Apr 20 17:51:29 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 HTTP/1.1 Apr 20 17:51:29 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:51:29 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:51:29 user devstack@n-api.service[61868]: Connection: close Apr 20 17:51:29 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:51:29 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:51:29 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:51:29 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:51:29 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmZTV_qJsYx0CNGLP-1hOsg984hFjBXUfliddGKuzo13xkRJSMN1hgaQEe_HxGSKdjeGO8ccDtiVMM5_wwxakxybFs6PtrOPsr9VnApHVdKVNdxByG4rsYw8solRLIQS_Fja6FDJXmCm4GCmjzwUFjFnPsvQp1vuWvpHKLkGvwPsr0 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Project-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Project-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Tenant: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Tenant-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-User: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:51:29 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:51:29 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:51:29 user devstack@n-api.service[61868]: X-User-Id: 0e87e05c599c44b3af17a42d3df1fc14 Apr 20 17:51:29 user devstack@n-api.service[61868]: X-User-Name: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:51:29 user devstack@n-api.service[61868]: method: > Apr 20 17:51:29 user devstack@n-api.service[61868]: exception: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61868]: action_args: {'id': '144ff119-1608-45ca-bd96-e648560c0a48'} Apr 20 17:51:29 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. Apr 20 17:51:29 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:51:29 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Returning 404 to user: Instance 144ff119-1608-45ca-bd96-e648560c0a48 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:51:29 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-84889f09-0d88-412d-8c47-375feda4e742 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48" status: 404 len: 111 microversion: 2.1 time: 0.032623 Apr 20 17:51:29 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:29 2023] GET /compute/v2.1/servers/144ff119-1608-45ca-bd96-e648560c0a48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:51:29 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-05119e20-d2b1-4a70-bd46-96585efc3e68 tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 204 len: 0 microversion: 2.1 time: 0.107883 Apr 20 17:51:29 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 111/334] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:51:29 2023] DELETE /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:30 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e87e05c599c44b3af17a42d3df1fc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e097e2307a48ada61048d11f4dfdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:30 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "name": "network-vif-unplugged", "status": "completed", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:30 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ed8f6f3f-b28b-497b-a287-d23aec0234ce tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 200 len: 1500 microversion: 2.1 time: 0.685650 Apr 20 17:51:30 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:29 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 1500 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:51:30 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:30 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:30 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:30 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] Creating event network-vif-unplugged:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:51:30 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-ea7d08bc-d405-4f94-bf5e-fac131b6befb req-a5b22940-e7f8-4738-98c8-b71715c1fa25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032603 Apr 20 17:51:30 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:32 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "name": "network-vif-plugged", "status": "completed", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}, {"server_uuid": "6b0b8219-4477-42c6-a946-7274514f2238", "name": "network-vif-deleted", "tag": "1693391b-23e5-4489-9553-e34cd36e41a4"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:51:32 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:32 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:32 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Creating event network-vif-plugged:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:51:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] Creating event network-vif-deleted:1693391b-23e5-4489-9553-e34cd36e41a4 for instance 6b0b8219-4477-42c6-a946-7274514f2238 on user Apr 20 17:51:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-6e38ac77-c45d-41fa-be0f-76ea3da0646c req-59e86cb1-29ad-4468-9a1a-7471e882a78d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032281 Apr 20 17:51:32 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 112/337] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:51:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:40 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:40 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-66ed4b7e-19d1-4d87-8841-20591a18d53d tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.227097 Apr 20 17:51:40 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 114/338] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:40 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=10 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=14 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:51:51 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:51:51 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-e5b8ae11-7d26-4b85-9374-7b495c59c051 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 200 len: 1491 microversion: 2.1 time: 0.288114 Apr 20 17:51:51 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 113/339] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:51:51 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 1491 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:14 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:14 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 HTTP/1.1 Apr 20 17:52:14 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:52:14 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:52:14 user devstack@n-api.service[61866]: Connection: close Apr 20 17:52:14 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:52:14 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:52:14 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:52:14 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:52:14 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:14 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:14 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:14 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:52:14 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:52:14 user devstack@n-api.service[61866]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:14 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:14 user devstack@n-api.service[61866]: method: > Apr 20 17:52:14 user devstack@n-api.service[61866]: exception: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:14 user devstack@n-api.service[61866]: action_args: {'id': '9e1954c1-b2db-4ff0-b387-24efe8b5db61'} Apr 20 17:52:14 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:14 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:14 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:14 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-8c5b3b1b-7102-4688-8023-d8225ce3a3c8 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 404 len: 111 microversion: 2.1 time: 0.035351 Apr 20 17:52:14 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 113/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:14 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:14 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-cfa9e95b-0583-4bc8-9142-b086be46cb2c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '.version_select at 0x7f342d6d2200>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:14 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:14 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:14 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-cfa9e95b-0583-4bc8-9142-b086be46cb2c tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597213983" status: 202 len: 0 microversion: 2.1 time: 0.024711 Apr 20 17:52:14 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:52:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597213983 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:15 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:15 user devstack@n-api.service[61868]: request: DELETE /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 HTTP/1.1 Apr 20 17:52:15 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:15 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:15 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:15 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:52:15 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:15 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:15 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:15 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:15 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:15 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:15 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:15 user devstack@n-api.service[61868]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:15 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:15 user devstack@n-api.service[61868]: method: > Apr 20 17:52:15 user devstack@n-api.service[61868]: exception: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61868]: action_args: {'id': '9e1954c1-b2db-4ff0-b387-24efe8b5db61'} Apr 20 17:52:15 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:15 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-7f1b8d9b-388a-4e4c-97f4-7170205ebeb1 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 404 len: 111 microversion: 2.1 time: 0.111188 Apr 20 17:52:15 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:52:15 2023] DELETE /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: 9e1954c1-b2db-4ff0-b387-24efe8b5db61] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:15 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 HTTP/1.1 Apr 20 17:52:15 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:52:15 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:52:15 user devstack@n-api.service[61866]: Connection: close Apr 20 17:52:15 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:52:15 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:52:15 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:52:15 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:52:15 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:15 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:15 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:15 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:52:15 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:52:15 user devstack@n-api.service[61866]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:15 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:15 user devstack@n-api.service[61866]: method: > Apr 20 17:52:15 user devstack@n-api.service[61866]: exception: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61866]: action_args: {'id': '9e1954c1-b2db-4ff0-b387-24efe8b5db61'} Apr 20 17:52:15 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. Apr 20 17:52:15 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:15 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance 9e1954c1-b2db-4ff0-b387-24efe8b5db61 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:15 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-90d09c00-7511-4843-93f1-f21b3f5cc2f0 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61" status: 404 len: 111 microversion: 2.1 time: 0.026883 Apr 20 17:52:15 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:15 2023] GET /compute/v2.1/servers/9e1954c1-b2db-4ff0-b387-24efe8b5db61 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:16 user devstack@n-api.service[61867]: request: DELETE /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b HTTP/1.1 Apr 20 17:52:16 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:52:16 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:52:16 user devstack@n-api.service[61867]: Connection: close Apr 20 17:52:16 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:52:16 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:52:16 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:52:16 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:52:16 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61867]: method: > Apr 20 17:52:16 user devstack@n-api.service[61867]: exception: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: action_args: {'id': 'a6bdbb76-a7bd-4a1e-90a8-1994016bff4b'} Apr 20 17:52:16 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-4bb8421b-35f7-41b3-965f-6c8ed12bc886 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 404 len: 111 microversion: 2.1 time: 0.029379 Apr 20 17:52:16 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:52:16 2023] DELETE /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: a6bdbb76-a7bd-4a1e-90a8-1994016bff4b] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:16 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b HTTP/1.1 Apr 20 17:52:16 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:16 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:16 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:16 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:52:16 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:16 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:16 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:16 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61868]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:16 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61868]: method: > Apr 20 17:52:16 user devstack@n-api.service[61868]: exception: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61868]: action_args: {'id': 'a6bdbb76-a7bd-4a1e-90a8-1994016bff4b'} Apr 20 17:52:16 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. Apr 20 17:52:16 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance a6bdbb76-a7bd-4a1e-90a8-1994016bff4b could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:16 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-cdc18fd0-eb29-420e-be40-63c22ce8ea81 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b" status: 404 len: 111 microversion: 2.1 time: 0.058742 Apr 20 17:52:16 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 115/345] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:16 2023] GET /compute/v2.1/servers/a6bdbb76-a7bd-4a1e-90a8-1994016bff4b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:16 user devstack@n-api.service[61866]: request: DELETE /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 HTTP/1.1 Apr 20 17:52:16 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:52:16 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:52:16 user devstack@n-api.service[61866]: Connection: close Apr 20 17:52:16 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:52:16 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:52:16 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:52:16 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:52:16 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61866]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:16 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61866]: method: > Apr 20 17:52:16 user devstack@n-api.service[61866]: exception: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61866]: action_args: {'id': 'bf308e1b-0bae-462d-94d9-fcb90d51b316'} Apr 20 17:52:16 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:16 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-4240dfe5-538b-497e-92f6-6243f853aa64 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 404 len: 111 microversion: 2.1 time: 0.028730 Apr 20 17:52:16 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 115/346] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:52:16 2023] DELETE /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] [instance: bf308e1b-0bae-462d-94d9-fcb90d51b316] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] HTTP exception thrown: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Request method failure captured: Apr 20 17:52:16 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 HTTP/1.1 Apr 20 17:52:16 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:52:16 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:52:16 user devstack@n-api.service[61867]: Connection: close Apr 20 17:52:16 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:52:16 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:52:16 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:52:16 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:52:16 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXnXJdnMLMguz3Jc20hiaskIDRLRGv3rGiJevm9hrc7dqrSjIfdgV5sBaSUBSZYcIHu9dKhLtA2_o6wQqak9GgMyyOY43ac4Y7kU2vEsx7fF_KTCpMc2cLmTm0sycUbVF_Kyte46y1ZuokOJodcIMxey14bR0iPapCjh5TQg_Ob4F74 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4bf3cb544974390875631ccb3d66e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant-Id: b4bf3cb544974390875631ccb3d66e6d Apr 20 17:52:16 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367527671 Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Id: 5962a317ea0249c7a8154bccbdf218ae Apr 20 17:52:16 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeNegativeTest-367527671-project-member Apr 20 17:52:16 user devstack@n-api.service[61867]: method: > Apr 20 17:52:16 user devstack@n-api.service[61867]: exception: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: action_args: {'id': 'bf308e1b-0bae-462d-94d9-fcb90d51b316'} Apr 20 17:52:16 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. Apr 20 17:52:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] Returning 404 to user: Instance bf308e1b-0bae-462d-94d9-fcb90d51b316 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-fc15fcd1-d421-42e7-b549-8ee15c49ff97 tempest-AttachVolumeNegativeTest-367527671 tempest-AttachVolumeNegativeTest-367527671-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316" status: 404 len: 111 microversion: 2.1 time: 0.028747 Apr 20 17:52:16 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 117/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:16 2023] GET /compute/v2.1/servers/bf308e1b-0bae-462d-94d9-fcb90d51b316 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] [instance: 6b0b8219-4477-42c6-a946-7274514f2238] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] HTTP exception thrown: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Request method failure captured: Apr 20 17:52:20 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 HTTP/1.1 Apr 20 17:52:20 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:20 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:20 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:20 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:52:20 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:20 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:20 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:20 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXmZTV_qJsYx0CNGLP-1hOsg984hFjBXUfliddGKuzo13xkRJSMN1hgaQEe_HxGSKdjeGO8ccDtiVMM5_wwxakxybFs6PtrOPsr9VnApHVdKVNdxByG4rsYw8solRLIQS_Fja6FDJXmCm4GCmjzwUFjFnPsvQp1vuWvpHKLkGvwPsr0 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Project-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Project-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f3e097e2307a48ada61048d11f4dfdb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Tenant: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Tenant-Id: f3e097e2307a48ada61048d11f4dfdb4 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-886821994 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-User: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:52:20 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:20 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:20 user devstack@n-api.service[61868]: X-User-Id: 0e87e05c599c44b3af17a42d3df1fc14 Apr 20 17:52:20 user devstack@n-api.service[61868]: X-User-Name: tempest-ServersNegativeTestJSON-886821994-project-member Apr 20 17:52:20 user devstack@n-api.service[61868]: method: > Apr 20 17:52:20 user devstack@n-api.service[61868]: exception: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. Apr 20 17:52:20 user devstack@n-api.service[61868]: action_args: {'id': '6b0b8219-4477-42c6-a946-7274514f2238'} Apr 20 17:52:20 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. Apr 20 17:52:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] Returning 404 to user: Instance 6b0b8219-4477-42c6-a946-7274514f2238 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-0fdc7884-f20a-4575-a20d-2b3bf5cd250f tempest-ServersNegativeTestJSON-886821994 tempest-ServersNegativeTestJSON-886821994-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238" status: 404 len: 111 microversion: 2.1 time: 0.033309 Apr 20 17:52:20 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:20 2023] GET /compute/v2.1/servers/6b0b8219-4477-42c6-a946-7274514f2238 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:20 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-caf959a9-c164-4e2f-84b9-ac79095e4bc4 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Action: 'create', calling method: .version_select at 0x7f342d716cb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-3049034"}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:52:21 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-caf959a9-c164-4e2f-84b9-ac79095e4bc4 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 0.481556 Apr 20 17:52:21 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 116/349] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 17:52:20 2023] POST /compute/v2.1/os-volumes => generated 342 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 17:52:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-450ae412-ab6a-4a42-a554-17bc1afa3033 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Calling method '.version_select at 0x7f342d6d3b50>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-450ae412-ab6a-4a42-a554-17bc1afa3033 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e" status: 200 len: 342 microversion: 2.1 time: 0.053453 Apr 20 17:52:21 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:52:21 2023] GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e => generated 342 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:52:22 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-94b91dce-fac5-46c2-913c-56664b829631 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Calling method '.version_select at 0x7f342d77ce50>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:22 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-94b91dce-fac5-46c2-913c-56664b829631 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e" status: 200 len: 339 microversion: 2.1 time: 0.096150 Apr 20 17:52:22 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 117/351] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:52:22 2023] GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e => generated 339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:52:22 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-55713b6e-8aa0-40de-9d05-99933684cdc1 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Calling method '.version_select at 0x7f342d6b4af0>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:22 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-55713b6e-8aa0-40de-9d05-99933684cdc1 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e" status: 202 len: 0 microversion: 2.1 time: 0.102157 Apr 20 17:52:22 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 117/352] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:52:22 2023] DELETE /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:52:22 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-2a25b510-4c32-444e-9aeb-c46d81ef0487 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Calling method '.version_select at 0x7f342d6d3d00>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:22 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-2a25b510-4c32-444e-9aeb-c46d81ef0487 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] HTTP exception thrown: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. Apr 20 17:52:22 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-2a25b510-4c32-444e-9aeb-c46d81ef0487 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Request method failure captured: Apr 20 17:52:22 user devstack@n-api.service[61867]: request: GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e HTTP/1.1 Apr 20 17:52:22 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:52:22 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:52:22 user devstack@n-api.service[61867]: Connection: close Apr 20 17:52:22 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:52:22 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:52:22 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:52:22 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:52:22 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXvUcvx2nWSNvduIdsQkYWhEaF_FdpYFbhFkP0Bx9m7AGKDxfBEePNfUp8WNvLvqChsVFv2GLBBg9tRD2BX-8UzeubFaYooP2UdAYI52I6n2The8st7nAtoTh0q1tOSSCHK-lW6dqoG4j-4tj94djjOXtJGhnDeYX3P2MCnPhUVLO2U Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Project-Id: d1c4b37402f94051a50ba266eeedc112 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1124166228 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c4b37402f94051a50ba266eeedc112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c4b37402f94051a50ba266eeedc112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c4b37402f94051a50ba266eeedc112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1124166228 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Tenant-Id: d1c4b37402f94051a50ba266eeedc112 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1124166228 Apr 20 17:52:22 user devstack@n-api.service[61867]: X-User: tempest-VolumesSnapshotsTestJSON-1124166228-project-member Apr 20 17:52:22 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:52:22 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:52:22 user devstack@n-api.service[61867]: X-User-Id: 77e4ce046d284e0f9085cda9f0bfb42d Apr 20 17:52:22 user devstack@n-api.service[61867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1124166228-project-member Apr 20 17:52:22 user devstack@n-api.service[61867]: method: Apr 20 17:52:22 user devstack@n-api.service[61867]: exception: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. Apr 20 17:52:22 user devstack@n-api.service[61867]: action_args: {'id': 'ec880df7-4eba-4288-9567-a52eaf364e2e'} Apr 20 17:52:22 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. (HTTP 404) (Request-ID: req-0b0d3e61-120d-41d6-b530-4118d5796716) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. Apr 20 17:52:22 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:22 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-2a25b510-4c32-444e-9aeb-c46d81ef0487 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] Returning 404 to user: Volume ec880df7-4eba-4288-9567-a52eaf364e2e could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:22 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-2a25b510-4c32-444e-9aeb-c46d81ef0487 tempest-VolumesSnapshotsTestJSON-1124166228 tempest-VolumesSnapshotsTestJSON-1124166228-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e" status: 404 len: 109 microversion: 2.1 time: 0.039063 Apr 20 17:52:22 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 119/353] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:52:22 2023] GET /compute/v2.1/os-volumes/ec880df7-4eba-4288-9567-a52eaf364e2e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-1e2358db-259b-47f2-96b9-d3f01dbe642e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Action: 'create', calling method: .version_select at 0x7f342d77f490>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-594817048", "metadata": {"Type": "work"}}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-1e2358db-259b-47f2-96b9-d3f01dbe642e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Length: 121 Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: Apr 20 17:52:24 user devstack@n-api.service[61868]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-594817048", "metadata": {"Type": "work"}}} Apr 20 17:52:24 user devstack@n-api.service[61868]: method: Apr 20 17:52:24 user devstack@n-api.service[61868]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61868]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-594817048', 'metadata': {'Type': 'work'}}}} Apr 20 17:52:24 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise error Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-1e2358db-259b-47f2-96b9-d3f01dbe642e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-1e2358db-259b-47f2-96b9-d3f01dbe642e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.166931 Apr 20 17:52:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 118/354] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 17:52:23 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-caf233e0-6f65-4339-89f5-3e3a86223c9e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Action: 'create', calling method: .version_select at 0x7f342d6b5990>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1951042052", "metadata": {"Type": "work"}}} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-caf233e0-6f65-4339-89f5-3e3a86223c9e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61866]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61866]: Content-Length: 120 Apr 20 17:52:24 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61866]: Apr 20 17:52:24 user devstack@n-api.service[61866]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1951042052", "metadata": {"Type": "work"}}} Apr 20 17:52:24 user devstack@n-api.service[61866]: method: Apr 20 17:52:24 user devstack@n-api.service[61866]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 17:52:24 user devstack@n-api.service[61866]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1951042052', 'metadata': {'Type': 'work'}}}} Apr 20 17:52:24 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise error Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi '0' Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-caf233e0-6f65-4339-89f5-3e3a86223c9e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-caf233e0-6f65-4339-89f5-3e3a86223c9e tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010715 Apr 20 17:52:24 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 118/355] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 17:52:24 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-90022646-8527-4ba7-89ab-cff71b3be382 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Action: 'create', calling method: .version_select at 0x7f342d7ea680>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1745477959", "metadata": {"Type": "work"}}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:52:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-90022646-8527-4ba7-89ab-cff71b3be382 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61867]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61867]: Content-Length: 119 Apr 20 17:52:24 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61867]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61867]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61867]: Apr 20 17:52:24 user devstack@n-api.service[61867]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1745477959", "metadata": {"Type": "work"}}} Apr 20 17:52:24 user devstack@n-api.service[61867]: method: Apr 20 17:52:24 user devstack@n-api.service[61867]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61867]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1745477959', 'metadata': {'Type': 'work'}}}} Apr 20 17:52:24 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise error Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi '' Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 17:52:24 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-90022646-8527-4ba7-89ab-cff71b3be382 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-90022646-8527-4ba7-89ab-cff71b3be382 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012818 Apr 20 17:52:24 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 120/356] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 17:52:24 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-039b6e2e-94d7-447f-b087-f231d518db13 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Calling method '.version_select at 0x7f342d9611b0>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-039b6e2e-94d7-447f-b087-f231d518db13 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] HTTP exception thrown: Volume tempest-invalid-428522372 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-039b6e2e-94d7-447f-b087-f231d518db13 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61868]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-428522372 HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: method: Apr 20 17:52:24 user devstack@n-api.service[61868]: exception: Volume tempest-invalid-428522372 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: action_args: {'id': 'tempest-invalid-428522372'} Apr 20 17:52:24 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-428522372 could not be found. (HTTP 404) (Request-ID: req-ad57f202-c501-4a75-9526-2b5a538d691b) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-428522372 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-428522372 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-428522372 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-039b6e2e-94d7-447f-b087-f231d518db13 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 404 to user: Volume tempest-invalid-428522372 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-039b6e2e-94d7-447f-b087-f231d518db13 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-428522372" status: 404 len: 98 microversion: 2.1 time: 0.039410 Apr 20 17:52:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 119/357] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 17:52:24 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-428522372 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-294dbdc7-54e2-4dcc-ab93-81adbe98bc95 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003526 Apr 20 17:52:24 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 119/358] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 17:52:24 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ca6aaf0d-4860-48a6-90b0-9737c1323e27 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003840 Apr 20 17:52:24 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 121/359] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 17:52:24 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-11c3a989-028a-45b2-971c-3ac8532f0937 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Calling method '.version_select at 0x7f342d77d6c0>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-11c3a989-028a-45b2-971c-3ac8532f0937 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] HTTP exception thrown: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-11c3a989-028a-45b2-971c-3ac8532f0937 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61868]: request: DELETE /compute/v2.1/os-volumes/33b048e5-66f7-4006-9050-d8765ae4d3f1 HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61868]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:52:24 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61868]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61868]: method: Apr 20 17:52:24 user devstack@n-api.service[61868]: exception: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: action_args: {'id': '33b048e5-66f7-4006-9050-d8765ae4d3f1'} Apr 20 17:52:24 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. (HTTP 404) (Request-ID: req-90fa7b5b-9130-48fb-badc-141040bd9be9) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-11c3a989-028a-45b2-971c-3ac8532f0937 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 404 to user: Volume 33b048e5-66f7-4006-9050-d8765ae4d3f1 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-11c3a989-028a-45b2-971c-3ac8532f0937 tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/33b048e5-66f7-4006-9050-d8765ae4d3f1" status: 404 len: 109 microversion: 2.1 time: 0.034021 Apr 20 17:52:24 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 120/360] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 17:52:24 2023] DELETE /compute/v2.1/os-volumes/33b048e5-66f7-4006-9050-d8765ae4d3f1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a0254b29-edd9-45c1-9f15-ac5de68c27bb tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Calling method '.version_select at 0x7f342d6b6b90>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-a0254b29-edd9-45c1-9f15-ac5de68c27bb tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] HTTP exception thrown: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a0254b29-edd9-45c1-9f15-ac5de68c27bb tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Request method failure captured: Apr 20 17:52:24 user devstack@n-api.service[61866]: request: GET /compute/v2.1/os-volumes/4a9fb835-301c-4789-b635-4d44aa8e86d6 HTTP/1.1 Apr 20 17:52:24 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:52:24 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:52:24 user devstack@n-api.service[61866]: Connection: close Apr 20 17:52:24 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:52:24 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:52:24 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:52:24 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:52:24 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXvXfUrLiBIwxgz_Jo1UuuI_EO9skQiJUiLvBLtWQIK5cLPINKgOLzeo7XxHGAOUv5oJA8bUlZfLaJxPkYhWNNbdgen0r7JIbjth61hr5AcdlgeozOOI5ugrNYjMYWB2NJwMbo36fVuWSiMCsvlnYGiyDdTZdFHl3CKhpxPCbn-9nUA Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Project-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/356dea28451a4847b046f900cf0715c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/356dea28451a4847b046f900cf0715c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant-Id: 356dea28451a4847b046f900cf0715c2 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-VolumesNegativeTest-1841825681 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Id: 279cec7278f643cb897e82b047de3521 Apr 20 17:52:24 user devstack@n-api.service[61866]: X-User-Name: tempest-VolumesNegativeTest-1841825681-project-member Apr 20 17:52:24 user devstack@n-api.service[61866]: method: Apr 20 17:52:24 user devstack@n-api.service[61866]: exception: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61866]: action_args: {'id': '4a9fb835-301c-4789-b635-4d44aa8e86d6'} Apr 20 17:52:24 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. (HTTP 404) (Request-ID: req-78a68149-9f42-4bfb-b33c-0adcd3ac6171) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. Apr 20 17:52:24 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:52:24 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a0254b29-edd9-45c1-9f15-ac5de68c27bb tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] Returning 404 to user: Volume 4a9fb835-301c-4789-b635-4d44aa8e86d6 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:52:24 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a0254b29-edd9-45c1-9f15-ac5de68c27bb tempest-VolumesNegativeTest-1841825681 tempest-VolumesNegativeTest-1841825681-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4a9fb835-301c-4789-b635-4d44aa8e86d6" status: 404 len: 109 microversion: 2.1 time: 0.035658 Apr 20 17:52:24 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 120/361] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 17:52:24 2023] GET /compute/v2.1/os-volumes/4a9fb835-301c-4789-b635-4d44aa8e86d6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:52:26 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:26 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1499497848"}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:28 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-6bdb1248-33f5-40f0-a92c-7106278f9a05 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c/action" status: 202 len: 52 microversion: 2.87 time: 1.154153 Apr 20 17:52:28 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 122/362] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 17:52:26 2023] POST /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c/action => generated 52 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:34 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:34 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-44bb4ffb-113c-48e5-93ae-89c2076a46ba tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 200 len: 1690 microversion: 2.87 time: 0.243917 Apr 20 17:52:34 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 121/363] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:52:34 2023] GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:41 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:41 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-cce58ff1-7e27-489a-ba44-066d480868b9 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.469134 Apr 20 17:52:41 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 121/364] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:41 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:41 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:42 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-170c0b0b-f027-46be-a797-377c4d79946c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.497276 Apr 20 17:52:42 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:41 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:42 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:42 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-72557309-c974-402f-9aeb-842c6d727a68 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.389953 Apr 20 17:52:42 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 122/366] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:42 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:52:51 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:52:52 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:52:52 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-a645caf0-3ccf-4247-963e-a2737036a5d1 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6" status: 200 len: 1504 microversion: 2.1 time: 0.580342 Apr 20 17:52:52 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:52:51 2023] GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:53:34 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1126218983", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "destination_type": "volume"}], "networks": [{"uuid": "699d9e3b-82b5-48ec-913e-e64620fd3440"}]}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:53:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:34 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:34 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] validate_networks() for [('699d9e3b-82b5-48ec-913e-e64620fd3440', None, None, None, None, None)] {{(pid=61867) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image limits 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Flavor pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Image pref 0:0:0 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.virt.hardware [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Getting quotas for user 33fc090f5bc6478a958614985155d7f1 and project abe42b4dbff64335881f530d3d3ba70c. Resources: {'cores', 'instances', 'ram'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Going to run 1 instances... {{(pid=61867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:53:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:53:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-6cafe061-9490-4265-8ebc-530f77a363ce tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.611101 Apr 20 17:53:35 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 124/368] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:53:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=12 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:53:35 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:53:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-60d2f0af-008f-497a-9918-d32e9cd57099 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06" status: 200 len: 1395 microversion: 2.87 time: 0.081536 Apr 20 17:53:35 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 123/369] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:53:35 2023] GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06 => generated 1395 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:53:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:37 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=6 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:38 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a96f2-a1db-4bad-a931-45de4d1a7d06", "tag": "f73e0074-d558-4b70-b905-3d8b7b4d2820"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:53:38 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:38 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:38 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:38 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] Creating event network-changed:f73e0074-d558-4b70-b905-3d8b7b4d2820 for instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 on user Apr 20 17:53:38 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-ef1f752c-fabf-42fa-9d68-158bcc4d8a4a req-929eb00c-8989-47c5-93c4-61a5da567640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134664 Apr 20 17:53:38 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:53:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a96f2-a1db-4bad-a931-45de4d1a7d06", "name": "network-vif-deleted", "tag": "f73e0074-d558-4b70-b905-3d8b7b4d2820"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:53:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:43 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:43 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.compute.server_external_events [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] Unable to find a host for instance 933a96f2-a1db-4bad-a931-45de4d1a7d06. Dropping event network-vif-deleted {{(pid=61867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 17:53:43 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-a609243f-de90-4c03-98ce-eee065f750ad req-9c9352f2-ea29-4c36-996c-fd9d45585fbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024815 Apr 20 17:53:43 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:44 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:53:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-0fdab033-952e-4cd9-85f3-c1fe73153d3a tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1658 microversion: 2.1 time: 0.275974 Apr 20 17:53:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:53:44 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1658 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:55 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:53:55 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-ae2ae9d3-1809-4fac-be31-4cce6b089f15 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 204 len: 0 microversion: 2.1 time: 0.116654 Apr 20 17:53:55 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 124/373] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:53:55 2023] DELETE /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=8 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:55 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] Creating event network-vif-unplugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:53:55 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-f6c2faf3-a7ae-4c97-9572-53a378b73385 req-6c1573ec-50b0-4b8a-99f4-f2e97143e8f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042175 Apr 20 17:53:55 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:53:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:53:55 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:53:55 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-9b82c71e-47f8-4d5e-a235-c3f215d39bcf tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 200 len: 1497 microversion: 2.1 time: 0.494835 Apr 20 17:53:55 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:53:55 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 1497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:53:57 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-plugged", "status": "completed", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}, {"server_uuid": "497b466e-8586-4847-bb74-4e9337a20a5d", "name": "network-vif-deleted", "tag": "5e397a62-84d1-44f4-9e0f-f8796718d91b"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:53:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:53:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:53:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:53:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Creating event network-vif-plugged:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:53:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] Creating event network-vif-deleted:5e397a62-84d1-44f4-9e0f-f8796718d91b for instance 497b466e-8586-4847-bb74-4e9337a20a5d on user Apr 20 17:53:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-10ab1045-008d-4b72-945f-9b6ed332d957 req-5bde3320-5bb4-4c53-b543-e3e367497a37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037941 Apr 20 17:53:57 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 125/376] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:53:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.objects.instance [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lazy-loading 'fault' on Instance uuid 933a96f2-a1db-4bad-a931-45de4d1a7d06 {{(pid=61868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:25 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-fc7eb7cb-ceba-4c11-8c69-405aa7f25800 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06" status: 200 len: 1650 microversion: 2.87 time: 0.127176 Apr 20 17:54:25 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:54:25 2023] GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06 => generated 1650 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Doing local delete in cell 1f878406-f865-4f02-bb10-aa57d0aa28b3(cell1) {{(pid=61867) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61867]: WARNING nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] instance's host None is down, deleting from database Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] deallocate_for_instance() {{(pid=61867) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Instance cache missing network info. {{(pid=61867) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.network.neutron [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Updating instance_info_cache with network_info: [] {{(pid=61867) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 17:54:25 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61867) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 17:54:25 user devstack@n-api.service[61867]: WARNING nova.compute.api [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 17:54:25 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-4d36956b-831e-44ac-97ec-9bb67873324b tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06" status: 204 len: 0 microversion: 2.87 time: 0.318211 Apr 20 17:54:25 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 127/378] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 17:54:25 2023] DELETE /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 933a96f2-a1db-4bad-a931-45de4d1a7d06] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] HTTP exception thrown: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Request method failure captured: Apr 20 17:54:25 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06 HTTP/1.1 Apr 20 17:54:25 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:54:25 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:54:25 user devstack@n-api.service[61866]: Connection: close Apr 20 17:54:25 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:54:25 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:54:25 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:54:25 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:54:25 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXqFOylYGTLxqAZ8lFGlf-eCanX2Z9qzUyUApX-Du8FTj4w2ACy--W-_d9jDiiJy4F4ULbY5F9AX-Y2ZSHFFuUzUNWGR8PKQpG8ggEBGnjDx4IXuM54jDmInT8_PHkYiAgR4DO3nvaeC3IhNUw3Dbf9WEzk02lYs9G3c2pr54DsmcKk Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Project-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Tenant-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:54:25 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-User: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:54:25 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:54:25 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:54:25 user devstack@n-api.service[61866]: X-User-Id: 33fc090f5bc6478a958614985155d7f1 Apr 20 17:54:25 user devstack@n-api.service[61866]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:54:25 user devstack@n-api.service[61866]: method: > Apr 20 17:54:25 user devstack@n-api.service[61866]: exception: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. Apr 20 17:54:25 user devstack@n-api.service[61866]: action_args: {'id': '933a96f2-a1db-4bad-a931-45de4d1a7d06'} Apr 20 17:54:25 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. Apr 20 17:54:25 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:54:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Returning 404 to user: Instance 933a96f2-a1db-4bad-a931-45de4d1a7d06 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:54:25 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-acebad41-7ef0-449b-b5d7-eeea6ec874b9 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06" status: 404 len: 111 microversion: 2.87 time: 0.038016 Apr 20 17:54:25 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 126/379] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:54:25 2023] GET /compute/v2.1/servers/933a96f2-a1db-4bad-a931-45de4d1a7d06 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:26 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Going to try to terminate instance {{(pid=61868) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:54:26 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-b08e600f-969e-449f-935c-6ff176feaf95 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 204 len: 0 microversion: 2.87 time: 0.118918 Apr 20 17:54:26 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 127/380] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 17:54:26 2023] DELETE /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:26 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:26 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-403518f3-72ad-4869-851a-1a6f4f6eef7f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 200 len: 1696 microversion: 2.87 time: 0.341024 Apr 20 17:54:26 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 128/381] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:54:26 2023] GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 1696 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:54:26 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "name": "network-vif-unplugged", "status": "completed", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:26 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] Creating event network-vif-unplugged:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:54:26 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-47175cae-0c84-4da8-8908-3938ad13ee66 req-533191f3-5352-4c22-bf4b-0f81fc7c5efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026994 Apr 20 17:54:26 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:28 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "name": "network-vif-plugged", "status": "completed", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}, {"server_uuid": "abece55a-d4ac-4beb-aaf4-827965e9603c", "name": "network-vif-deleted", "tag": "937df637-ab79-48d3-9bad-53429438c3dd"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Creating event network-vif-plugged:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:54:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] Creating event network-vif-deleted:937df637-ab79-48d3-9bad-53429438c3dd for instance abece55a-d4ac-4beb-aaf4-827965e9603c on user Apr 20 17:54:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-0d2437d4-a103-4a2e-8602-7bb542d8400d req-858ebbb7-8365-4cdd-a66b-698f72fa248c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030347 Apr 20 17:54:28 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:44 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:54:45 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-40216136-c7f2-4a50-9eeb-0cacc97d0a53 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 204 len: 0 microversion: 2.1 time: 0.227513 Apr 20 17:54:45 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 129/384] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:54:44 2023] DELETE /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:45 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1845b9cd94240a29608d4ebbd39e9a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71be84bd42247d580074ab83b838bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:45 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d48f8ba5-b43d-4f05-b34d-629cdf3867d6 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 200 len: 1664 microversion: 2.1 time: 0.376624 Apr 20 17:54:45 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:54:45 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 1664 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "name": "network-vif-unplugged", "status": "completed", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:45 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:45 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] Creating event network-vif-unplugged:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:54:45 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-64e82996-6747-42a1-a389-9e1b717a7063 req-ef01b1b2-8979-4d14-9e93-09a73331fe05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129156 Apr 20 17:54:45 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 497b466e-8586-4847-bb74-4e9337a20a5d] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] HTTP exception thrown: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Request method failure captured: Apr 20 17:54:46 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d HTTP/1.1 Apr 20 17:54:46 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:54:46 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:54:46 user devstack@n-api.service[61867]: Connection: close Apr 20 17:54:46 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:54:46 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:54:46 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:54:46 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:54:46 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXsUgsNOadvDoGqMcJnm-xNBA3yiDK3D68K93we0eHq_Q0Yiw__2j4Gku8HXmlAlTQ0LH8fSFkOAT1RtlA1ABXOCXBYc-0bYac5WCxo2IQ-U3tL4p3ugXKFbhU5SwqdMdRDmCHyAUdlY8mknJcMFOoXtF2wDdvmWixSyEbjkBH3huf4 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Project-Id: 49db491e5f6840e5813a5c6f5444bcc3 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Tenant-Id: 49db491e5f6840e5813a5c6f5444bcc3 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-User: tempest-ServerRescueNegativeTestJSON-2143923355-project-member Apr 20 17:54:46 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:54:46 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:54:46 user devstack@n-api.service[61867]: X-User-Id: 67028dfc02dc439b9aef77327a424409 Apr 20 17:54:46 user devstack@n-api.service[61867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2143923355-project-member Apr 20 17:54:46 user devstack@n-api.service[61867]: method: > Apr 20 17:54:46 user devstack@n-api.service[61867]: exception: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. Apr 20 17:54:46 user devstack@n-api.service[61867]: action_args: {'id': '497b466e-8586-4847-bb74-4e9337a20a5d'} Apr 20 17:54:46 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. Apr 20 17:54:46 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Returning 404 to user: Instance 497b466e-8586-4847-bb74-4e9337a20a5d could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:54:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-5775e867-7442-4ae8-af8d-004caf46187d tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d" status: 404 len: 111 microversion: 2.1 time: 0.168453 Apr 20 17:54:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:54:45 2023] GET /compute/v2.1/servers/497b466e-8586-4847-bb74-4e9337a20a5d => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:54:46 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-350ec18f-5ea8-459b-9a65-145793e81521 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6" status: 204 len: 0 microversion: 2.1 time: 0.112153 Apr 20 17:54:46 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 129/388] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:54:46 2023] DELETE /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67028dfc02dc439b9aef77327a424409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49db491e5f6840e5813a5c6f5444bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:54:46 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-76ef5060-aa8d-4f36-9538-15c142206cb0 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6" status: 200 len: 1510 microversion: 2.1 time: 0.286180 Apr 20 17:54:46 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:54:46 2023] GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "name": "network-vif-unplugged", "status": "completed", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] Creating event network-vif-unplugged:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:54:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-d48fb4e5-9e4c-43ab-9ec9-9f20b3a9d62a req-bb4aae67-4423-49e3-ae7a-8dd38f7cf7a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041857 Apr 20 17:54:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:47 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "name": "network-vif-plugged", "status": "completed", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:47 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] Creating event network-vif-plugged:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:54:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-f5220db4-a6d4-47a6-9b82-7415960d6a93 req-53034bf3-60e4-4cd8-8925-58a59cf64992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026693 Apr 20 17:54:47 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:54:48 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "name": "network-vif-plugged", "status": "completed", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}, {"server_uuid": "38dae7f7-4b58-4788-9914-e2ae9c9ef314", "name": "network-vif-deleted", "tag": "2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa"}, {"server_uuid": "68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6", "name": "network-vif-deleted", "tag": "35d34a3e-b2ea-4275-8d68-9ca288003215"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:54:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:54:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:54:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:54:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Creating event network-vif-plugged:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:54:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Creating event network-vif-deleted:2d35eab2-4f50-48b8-9c8d-cb5d9f2dbbfa for instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 on user Apr 20 17:54:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] Creating event network-vif-deleted:35d34a3e-b2ea-4275-8d68-9ca288003215 for instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 on user Apr 20 17:54:48 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-6f696e3f-9dd2-4cc7-b446-78189b25f386 req-f61d7c56-f82c-47d8-a9d0-ed83a1a691f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040357 Apr 20 17:54:48 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:54:48 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: abece55a-d4ac-4beb-aaf4-827965e9603c] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] HTTP exception thrown: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Request method failure captured: Apr 20 17:55:16 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c HTTP/1.1 Apr 20 17:55:16 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:55:16 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:55:16 user devstack@n-api.service[61867]: Connection: close Apr 20 17:55:16 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:55:16 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:55:16 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:55:16 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:55:16 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXqFOylYGTLxqAZ8lFGlf-eCanX2Z9qzUyUApX-Du8FTj4w2ACy--W-_d9jDiiJy4F4ULbY5F9AX-Y2ZSHFFuUzUNWGR8PKQpG8ggEBGnjDx4IXuM54jDmInT8_PHkYiAgR4DO3nvaeC3IhNUw3Dbf9WEzk02lYs9G3c2pr54DsmcKk Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Project-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Tenant-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:55:16 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-User: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:55:16 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:55:16 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:55:16 user devstack@n-api.service[61867]: X-User-Id: 33fc090f5bc6478a958614985155d7f1 Apr 20 17:55:16 user devstack@n-api.service[61867]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:55:16 user devstack@n-api.service[61867]: method: > Apr 20 17:55:16 user devstack@n-api.service[61867]: exception: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. Apr 20 17:55:16 user devstack@n-api.service[61867]: action_args: {'id': 'abece55a-d4ac-4beb-aaf4-827965e9603c'} Apr 20 17:55:16 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. Apr 20 17:55:16 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:16 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Returning 404 to user: Instance abece55a-d4ac-4beb-aaf4-827965e9603c could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:55:16 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-b44543ce-13af-462d-aca2-5039f5bc540f tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c" status: 404 len: 111 microversion: 2.87 time: 0.044782 Apr 20 17:55:16 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 132/393] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:55:16 2023] GET /compute/v2.1/servers/abece55a-d4ac-4beb-aaf4-827965e9603c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:16 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:55:17 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c9e44d58-d0fd-4871-afbd-2c4b46de428e tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 204 len: 0 microversion: 2.87 time: 0.154974 Apr 20 17:55:17 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 131/394] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 17:55:16 2023] DELETE /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=10 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:17 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "name": "network-vif-unplugged", "status": "completed", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:17 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] Creating event network-vif-unplugged:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:55:17 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-a4c0cf1d-40af-4061-b822-48a71cc13c4a req-7aa77035-a3a2-4e74-8d18-fff3d7ebc5fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030283 Apr 20 17:55:17 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 133/395] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:17 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33fc090f5bc6478a958614985155d7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe42b4dbff64335881f530d3d3ba70c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:17 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-b8247b3e-6dba-4b19-9c97-1147ae0e4704 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 200 len: 1698 microversion: 2.87 time: 0.314309 Apr 20 17:55:17 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 132/396] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:55:17 2023] GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 1698 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 17:55:19 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "name": "network-vif-plugged", "status": "completed", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}, {"server_uuid": "73a6e829-7557-449e-9a95-22f81a1a5150", "name": "network-vif-deleted", "tag": "07b836e6-1fd9-4fc8-a3e8-716903955328"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:19 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:19 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Creating event network-vif-plugged:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:55:19 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] Creating event network-vif-deleted:07b836e6-1fd9-4fc8-a3e8-716903955328 for instance 73a6e829-7557-449e-9a95-22f81a1a5150 on user Apr 20 17:55:19 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-6586682a-9254-4842-b6b9-5c927b7e66ed req-eb66758a-e75c-492f-b724-6460d1e15d78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036074 Apr 20 17:55:19 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 132/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] [instance: 38dae7f7-4b58-4788-9914-e2ae9c9ef314] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] HTTP exception thrown: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Request method failure captured: Apr 20 17:55:35 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 HTTP/1.1 Apr 20 17:55:35 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:55:35 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:55:35 user devstack@n-api.service[61867]: Connection: close Apr 20 17:55:35 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:55:35 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:55:35 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:55:35 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:55:35 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXpOtV-UgILXBS15oLG0eLxEeEvlbzGt01rpje7nLL6yZGGezVorJyKKPS06nqVihzvEGlMBioLcs5EJEz19cnlIwM3eL9SDn2fjH-1ShBhSiAq640cQ1lUsBsnlFsDA0YLZrryhUJFkcGADjlCT3Lemplv-_5zQBeT_O973gGQq-gE Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Project-Id: e71be84bd42247d580074ab83b838bb7 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Project-Name: tempest-ServerActionsTestJSON-1278332395 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e71be84bd42247d580074ab83b838bb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e71be84bd42247d580074ab83b838bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e71be84bd42247d580074ab83b838bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Tenant: tempest-ServerActionsTestJSON-1278332395 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Tenant-Id: e71be84bd42247d580074ab83b838bb7 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-ServerActionsTestJSON-1278332395 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-User: tempest-ServerActionsTestJSON-1278332395-project-member Apr 20 17:55:35 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:55:35 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:55:35 user devstack@n-api.service[61867]: X-User-Id: e1845b9cd94240a29608d4ebbd39e9a5 Apr 20 17:55:35 user devstack@n-api.service[61867]: X-User-Name: tempest-ServerActionsTestJSON-1278332395-project-member Apr 20 17:55:35 user devstack@n-api.service[61867]: method: > Apr 20 17:55:35 user devstack@n-api.service[61867]: exception: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. Apr 20 17:55:35 user devstack@n-api.service[61867]: action_args: {'id': '38dae7f7-4b58-4788-9914-e2ae9c9ef314'} Apr 20 17:55:35 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. Apr 20 17:55:35 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:55:35 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Returning 404 to user: Instance 38dae7f7-4b58-4788-9914-e2ae9c9ef314 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:55:35 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-a44db72a-7f00-4fd9-b848-405d3b39c676 tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314" status: 404 len: 111 microversion: 2.1 time: 0.032321 Apr 20 17:55:35 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 134/398] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:55:35 2023] GET /compute/v2.1/servers/38dae7f7-4b58-4788-9914-e2ae9c9ef314 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:55:35 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-4318d5ef-2949-401d-b8d2-731f6596085c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] Calling method '.version_select at 0x7f342d77c940>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:35 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:35 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-4318d5ef-2949-401d-b8d2-731f6596085c tempest-ServerActionsTestJSON-1278332395 tempest-ServerActionsTestJSON-1278332395-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-153238431" status: 202 len: 0 microversion: 2.1 time: 0.027866 Apr 20 17:55:35 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 17:55:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-153238431 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] [instance: 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:36 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] HTTP exception thrown: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Request method failure captured: Apr 20 17:55:36 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 HTTP/1.1 Apr 20 17:55:36 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:55:36 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:55:36 user devstack@n-api.service[61866]: Connection: close Apr 20 17:55:36 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:55:36 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:55:36 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:55:36 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:55:36 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXsUgsNOadvDoGqMcJnm-xNBA3yiDK3D68K93we0eHq_Q0Yiw__2j4Gku8HXmlAlTQ0LH8fSFkOAT1RtlA1ABXOCXBYc-0bYac5WCxo2IQ-U3tL4p3ugXKFbhU5SwqdMdRDmCHyAUdlY8mknJcMFOoXtF2wDdvmWixSyEbjkBH3huf4 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Project-Id: 49db491e5f6840e5813a5c6f5444bcc3 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49db491e5f6840e5813a5c6f5444bcc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Tenant-Id: 49db491e5f6840e5813a5c6f5444bcc3 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2143923355 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-User: tempest-ServerRescueNegativeTestJSON-2143923355-project-member Apr 20 17:55:36 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:55:36 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:55:36 user devstack@n-api.service[61866]: X-User-Id: 67028dfc02dc439b9aef77327a424409 Apr 20 17:55:36 user devstack@n-api.service[61866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2143923355-project-member Apr 20 17:55:36 user devstack@n-api.service[61866]: method: > Apr 20 17:55:36 user devstack@n-api.service[61866]: exception: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. Apr 20 17:55:36 user devstack@n-api.service[61866]: action_args: {'id': '68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6'} Apr 20 17:55:36 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. Apr 20 17:55:36 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:55:36 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] Returning 404 to user: Instance 68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:55:36 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-99c3b704-a063-4cec-a639-d669475e1ef4 tempest-ServerRescueNegativeTestJSON-2143923355 tempest-ServerRescueNegativeTestJSON-2143923355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6" status: 404 len: 111 microversion: 2.1 time: 0.037713 Apr 20 17:55:36 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 133/400] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:55:36 2023] GET /compute/v2.1/servers/68b3ca2b-af0d-4fa2-be68-ae1b8a293ae6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:55:46 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:46 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-25f3286a-d10e-4f26-8c73-38bcebe01a57 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Action: 'create', calling method: .version_select at 0x7f342d51ecb0>, body: {"keypair": {"name": "tempest-keypair-1572988008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK28+k2NHFWwBJ45Pgnij0rYGwscf/wgQwKjJ9hMql/Ah1G+enH+VmsTDZ/D/St2KDxN113M39bfG5G/GdMjdIzFN2e/VZNdp6eoICHZcl3IKQx+BCNI50mo9uWTbCNYgw=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-25f3286a-d10e-4f26-8c73-38bcebe01a57 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:55:46 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-25f3286a-d10e-4f26-8c73-38bcebe01a57 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for user 377d01af97a94e36946304d8f4cf2d7c and project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:55:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-25f3286a-d10e-4f26-8c73-38bcebe01a57 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.181599 Apr 20 17:55:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 135/401] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 17:55:46 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1776770964", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "12a4e0fc-5a42-4b2d-a0b3-8e1cd28b8fa3"}], "security_groups": [{"name": "tempest-securitygroup--1764430670"}], "key_name": "tempest-keypair-1572988008", "user_data": "}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] validate_networks() for [('12a4e0fc-5a42-4b2d-a0b3-8e1cd28b8fa3', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for user 377d01af97a94e36946304d8f4cf2d7c and project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:55:48 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:55:49 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-8ab35fc2-34b0-4a3a-80f0-8671726a4d0d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.963289 Apr 20 17:55:49 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 134/402] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:55:48 2023] POST /compute/v2.1/servers => generated 400 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:49 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:49 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e6c2dc59-f1ad-4432-b51d-d44647edf62e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 200 len: 1276 microversion: 2.20 time: 0.072915 Apr 20 17:55:49 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 134/403] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:55:49 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 1276 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:55:52 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:52 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] Creating event network-changed:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:55:52 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-a95abea2-ca9b-4228-88f5-76a08b9ffe3f req-a06cacba-c853-45d1-8ff2-1a4dd0db8082 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029297 Apr 20 17:55:52 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-717254349", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "networks": [{"uuid": "9a4f034b-bfa6-40a8-8ad4-94e5a8514a43"}]}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] validate_networks() for [('9a4f034b-bfa6-40a8-8ad4-94e5a8514a43', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Getting quotas for project 973ac0d1b8764270af9a76d78fb28c91. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Getting quotas for user 6ed147c0245640dfbcf646a06b47b6ff and project 973ac0d1b8764270af9a76d78fb28c91. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:55:54 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:55:54 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-3afe539d-a1f6-4367-a779-ef37ecfa517a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.631560 Apr 20 17:55:54 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 135/405] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 17:55:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 17:55:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-e9d6b9b9-1d3c-47b1-bd31-9823685c2804 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:55:54 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-e9d6b9b9-1d3c-47b1-bd31-9823685c2804 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:55:54 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-e9d6b9b9-1d3c-47b1-bd31-9823685c2804 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed147c0245640dfbcf646a06b47b6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973ac0d1b8764270af9a76d78fb28c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:55:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-e9d6b9b9-1d3c-47b1-bd31-9823685c2804 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3" status: 200 len: 1207 microversion: 2.1 time: 0.095867 Apr 20 17:55:54 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 135/406] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:55:54 2023] GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:55:54 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "name": "network-vif-plugged", "status": "completed", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:54 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:54 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] Creating event network-vif-plugged:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:55:55 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-f020528f-f60b-4449-add9-e91ef2139e35 req-ecc1db51-e96f-4710-a87a-c763293c06ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123357 Apr 20 17:55:55 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 137/407] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:56 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:57 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] Creating event network-changed:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:55:57 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-79052b30-3fc5-4d9a-ad92-77687825eac9 req-80c4b0c7-4dd2-4207-bb70-0944925c8526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028654 Apr 20 17:55:57 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 136/408] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:57 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "name": "network-vif-plugged", "status": "completed", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:57 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] Creating event network-vif-plugged:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:55:57 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-8cc20320-2ce3-4dcc-bb9d-379f8ad06264 req-370ec8b7-d2c0-4a81-9218-0a85d2eac3e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Apr 20 17:55:57 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:55:59 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:55:59 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "name": "network-vif-plugged", "status": "completed", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:55:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:55:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:55:59 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:55:59 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] Creating event network-vif-plugged:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:55:59 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-6c750976-519a-4ebf-a70b-d4d7a1eced46 req-6f546e25-bc93-4ea0-9314-c88c26f77e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063236 Apr 20 17:55:59 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 138/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:56:01 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "name": "network-vif-plugged", "status": "completed", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:56:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:01 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:01 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] Creating event network-vif-plugged:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:56:01 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-deb39c1e-d7c0-46be-ac8b-e8ad7666a83e req-c8cb79f8-2224-4447-b03d-eb67811e0eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Apr 20 17:56:01 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=4 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=10 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] [instance: 73a6e829-7557-449e-9a95-22f81a1a5150] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:07 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] HTTP exception thrown: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Request method failure captured: Apr 20 17:56:07 user devstack@n-api.service[61866]: request: GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 HTTP/1.1 Apr 20 17:56:07 user devstack@n-api.service[61866]: Accept: application/json Apr 20 17:56:07 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 17:56:07 user devstack@n-api.service[61866]: Connection: close Apr 20 17:56:07 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 17:56:07 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 17:56:07 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 17:56:07 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 17:56:07 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXqFOylYGTLxqAZ8lFGlf-eCanX2Z9qzUyUApX-Du8FTj4w2ACy--W-_d9jDiiJy4F4ULbY5F9AX-Y2ZSHFFuUzUNWGR8PKQpG8ggEBGnjDx4IXuM54jDmInT8_PHkYiAgR4DO3nvaeC3IhNUw3Dbf9WEzk02lYs9G3c2pr54DsmcKk Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Project-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/abe42b4dbff64335881f530d3d3ba70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Tenant-Id: abe42b4dbff64335881f530d3d3ba70c Apr 20 17:56:07 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-User: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:56:07 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 17:56:07 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 17:56:07 user devstack@n-api.service[61866]: X-User-Id: 33fc090f5bc6478a958614985155d7f1 Apr 20 17:56:07 user devstack@n-api.service[61866]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member Apr 20 17:56:07 user devstack@n-api.service[61866]: method: > Apr 20 17:56:07 user devstack@n-api.service[61866]: exception: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. Apr 20 17:56:07 user devstack@n-api.service[61866]: action_args: {'id': '73a6e829-7557-449e-9a95-22f81a1a5150'} Apr 20 17:56:07 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. Apr 20 17:56:07 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 17:56:07 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] Returning 404 to user: Instance 73a6e829-7557-449e-9a95-22f81a1a5150 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:56:07 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-57d74861-2f58-43a9-80da-94d3d8c94bc4 tempest-ServerBootFromVolumeStableRescueTest-711862647 tempest-ServerBootFromVolumeStableRescueTest-711862647-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150" status: 404 len: 111 microversion: 2.87 time: 0.032272 Apr 20 17:56:07 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 137/412] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:56:07 2023] GET /compute/v2.1/servers/73a6e829-7557-449e-9a95-22f81a1a5150 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:56:39 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:56:39 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d290f720-da35-4170-b9e9-ea86962c425f tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 200 len: 1589 microversion: 2.20 time: 0.274467 Apr 20 17:56:39 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 139/413] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:56:39 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 1589 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=12 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=8 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:56:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:56:45 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed147c0245640dfbcf646a06b47b6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973ac0d1b8764270af9a76d78fb28c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:56:45 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-840fd3f1-11eb-4f6b-bbf8-1cbe4f269c51 tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3" status: 200 len: 1485 microversion: 2.1 time: 0.236486 Apr 20 17:56:45 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:56:44 2023] GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 => generated 1485 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:57:39 user devstack@n-api.service[61866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 17:57:39 user devstack@n-api.service[61866]: Thu Apr 20 17:57:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2/os-interface (ip 10.0.0.210) !!! Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:39 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:39 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d3874aaa-99f1-41bb-ab34-1aed6206c4f6 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.184164 Apr 20 17:57:39 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 138/415] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 17:57:39 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2/os-interface => generated 283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=2 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:40 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:40 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] Creating event network-changed:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:57:40 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-75d52fca-4405-45b7-bb0f-9cd8c7b60a6e req-7f1131eb-0f06-4cd7-b62d-a4f1a3fe943d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036128 Apr 20 17:57:40 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:40 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:40 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-4014a2a7-73ab-46e3-8742-06824fc8e945 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2/ips" status: 200 len: 111 microversion: 2.20 time: 0.041451 Apr 20 17:57:40 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 139/417] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 17:57:40 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2/ips => generated 111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:41 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:57:42 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-fb7d1594-b2cf-4807-b243-b5d099229921 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 204 len: 0 microversion: 2.20 time: 0.106709 Apr 20 17:57:42 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 139/418] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 17:57:41 2023] DELETE /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:42 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:42 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:42 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] Creating event network-vif-unplugged:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:57:42 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-8684c961-45c9-427e-8274-109b0f06ca88 req-bf8621b5-59d8-4c34-ba5c-8b59ee6c0cb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052970 Apr 20 17:57:42 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:57:42 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:57:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-1b824c39-5ea6-4fff-b1bb-4fb2fc3b1aa3 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 200 len: 1714 microversion: 2.20 time: 0.540637 Apr 20 17:57:42 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 141/420] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:57:42 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 1714 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 17:57:43 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "name": "network-vif-deleted", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:43 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:43 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] Creating event network-vif-deleted:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:57:43 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-f16e991c-796e-4456-a420-4259b3f7825b req-abc04fd7-1342-43d2-a97e-50bbf86fc4d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029328 Apr 20 17:57:43 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 140/421] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:57:44 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bf3e28-a250-48df-9246-59c132665ba2", "name": "network-vif-plugged", "status": "completed", "tag": "e3b6753f-02c4-4794-a337-292658d9039f"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:44 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] Creating event network-vif-plugged:e3b6753f-02c4-4794-a337-292658d9039f for instance 20bf3e28-a250-48df-9246-59c132665ba2 on user Apr 20 17:57:44 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-79662ef2-c757-4e02-9d31-3edfa60dfb8f req-89e8d1a2-ebe8-480f-95f6-9a0b6cb6422d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Apr 20 17:57:44 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 141/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:46 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Going to try to terminate instance {{(pid=61867) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 17:57:46 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-147ce636-5212-4aa6-bad0-245d5f05776a tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3" status: 204 len: 0 microversion: 2.1 time: 0.111603 Apr 20 17:57:46 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 17:57:46 2023] DELETE /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:46 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:47 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:47 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:47 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] Creating event network-vif-unplugged:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:57:47 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-1f826b3d-2875-476d-a248-6fc4a76312b3 req-16e7dd51-77b7-40c0-bbf3-650ba226e0cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029313 Apr 20 17:57:47 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:57:47 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed147c0245640dfbcf646a06b47b6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973ac0d1b8764270af9a76d78fb28c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:57:47 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-4b5bf4cc-2af4-4ccf-ab9f-686549c1536b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3" status: 200 len: 1491 microversion: 2.1 time: 0.344115 Apr 20 17:57:47 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 141/425] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:57:46 2023] GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 => generated 1491 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 17:57:49 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "name": "network-vif-plugged", "status": "completed", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}, {"server_uuid": "436b0a7e-3636-4285-a8cf-48574352b9f3", "name": "network-vif-deleted", "tag": "392d7682-9f59-4cb3-adad-bf5b2def7533"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:57:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:57:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:57:49 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:57:49 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Creating event network-vif-plugged:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:57:49 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] Creating event network-vif-deleted:392d7682-9f59-4cb3-adad-bf5b2def7533 for instance 436b0a7e-3636-4285-a8cf-48574352b9f3 on user Apr 20 17:57:49 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-2f319ceb-0abd-418f-947e-5ddc06c8619d req-9235b358-4b31-41f6-8eab-7e6842e0dfc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028630 Apr 20 17:57:49 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 143/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=8 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=10 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 17:58:32 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 HTTP/1.1 Apr 20 17:58:32 user devstack@n-api.service[61868]: Accept: application/json Apr 20 17:58:32 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 17:58:32 user devstack@n-api.service[61868]: Connection: close Apr 20 17:58:32 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 17:58:32 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 17:58:32 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 17:58:32 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 17:58:32 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 17:58:32 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 17:58:32 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 17:58:32 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 17:58:32 user devstack@n-api.service[61868]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 17:58:32 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 17:58:32 user devstack@n-api.service[61868]: method: > Apr 20 17:58:32 user devstack@n-api.service[61868]: exception: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 17:58:32 user devstack@n-api.service[61868]: action_args: {'id': '20bf3e28-a250-48df-9246-59c132665ba2'} Apr 20 17:58:32 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 17:58:32 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 17:58:32 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:58:32 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-086b043f-9382-4610-8ef4-9d61363bc8bf tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 404 len: 111 microversion: 2.20 time: 0.036452 Apr 20 17:58:32 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 143/427] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:58:32 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 17:58:32 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c6cf9b43-b609-42db-921b-f5550735939b tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '.version_select at 0x7f342d716170>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:58:32 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:32 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:32 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c6cf9b43-b609-42db-921b-f5550735939b tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572988008" status: 204 len: 0 microversion: 2.20 time: 0.034194 Apr 20 17:58:32 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 142/428] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 17:58:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572988008 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 17:58:33 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:33 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:58:33 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-5f918fce-d74d-4d30-9fc2-688bae4787ef tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Action: 'create', calling method: .version_select at 0x7f342d51f130>, body: {"keypair": {"name": "tempest-keypair-1090953050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZ77eU9r4NOd5ZuyvsKOXeqwbxyVqWGdPmv0bfYOwTtQmE5TK+Pwd+iG6nZu1VUOVPSXW9fnnBkAfhH+uY1mZHkBu5JzsPgPhy4a7e5Luw/LAeAlRbTEXr3wYrwBtyEVQ=="}} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:58:33 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-5f918fce-d74d-4d30-9fc2-688bae4787ef tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:58:33 user devstack@n-api.service[61867]: DEBUG nova.quota [None req-5f918fce-d74d-4d30-9fc2-688bae4787ef tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for user 377d01af97a94e36946304d8f4cf2d7c and project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'key_pairs'} {{(pid=61867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:58:33 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-5f918fce-d74d-4d30-9fc2-688bae4787ef tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054780 Apr 20 17:58:33 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 144/429] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 17:58:33 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 17:58:34 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2012585239", "imageRef": "1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "12a4e0fc-5a42-4b2d-a0b3-8e1cd28b8fa3"}], "security_groups": [{"name": "tempest-securitygroup--902656322"}], "key_name": "tempest-keypair-1090953050", "user_data": "}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.network.neutron [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] validate_networks() for [('12a4e0fc-5a42-4b2d-a0b3-8e1cd28b8fa3', None, None, None, None, None)] {{(pid=61868) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Flavor limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Image limits 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Flavor pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Image pref 0:0:0 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.virt.hardware [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Getting quotas for user 377d01af97a94e36946304d8f4cf2d7c and project 5995f15ea45a4b4590b2d181ae5d7907. Resources: {'cores', 'instances', 'ram'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Going to run 1 instances... {{(pid=61868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 17:58:35 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1eef6075-ad0d-4c6b-aa7c-85c45fc23b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 17:58:35 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-4adb0e53-b1af-46c1-af33-2ae0c86c3f15 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.729555 Apr 20 17:58:35 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 144/430] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 17:58:34 2023] POST /compute/v2.1/servers => generated 399 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 17:58:35 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:58:35 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:58:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:58:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:58:35 user devstack@n-api.service[61866]: DEBUG nova.policy [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61866) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:58:35 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-c7f00a3d-ef74-4523-b314-1482bfcbc430 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 200 len: 1276 microversion: 2.20 time: 0.065481 Apr 20 17:58:35 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 143/431] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:58:35 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 1276 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] [instance: 436b0a7e-3636-4285-a8cf-48574352b9f3] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:37 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] HTTP exception thrown: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Request method failure captured: Apr 20 17:58:37 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 HTTP/1.1 Apr 20 17:58:37 user devstack@n-api.service[61867]: Accept: application/json Apr 20 17:58:37 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 17:58:37 user devstack@n-api.service[61867]: Connection: close Apr 20 17:58:37 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 17:58:37 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 17:58:37 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 17:58:37 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 17:58:37 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXyoUMlIpRlIZziPILN9TYIL5YuvPsBXcvRgrtMdUqOpsgxhJujfw_edXBvHop9niIMFXp4iEakY-qp1gXwXOjLimeB09IjYbsBmt9JR4HM2bn1J908D4XTLIGNmcpisBmmUurGCUWhvc2n1ozdbCDhpJQ805tdQhUMippAZX5Ijgi0 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Project-Id: 973ac0d1b8764270af9a76d78fb28c91 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Project-Name: tempest-VolumesActionsTest-1269335110 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973ac0d1b8764270af9a76d78fb28c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/973ac0d1b8764270af9a76d78fb28c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973ac0d1b8764270af9a76d78fb28c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Tenant: tempest-VolumesActionsTest-1269335110 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Tenant-Id: 973ac0d1b8764270af9a76d78fb28c91 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-VolumesActionsTest-1269335110 Apr 20 17:58:37 user devstack@n-api.service[61867]: X-User: tempest-VolumesActionsTest-1269335110-project-member Apr 20 17:58:37 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 17:58:37 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 17:58:37 user devstack@n-api.service[61867]: X-User-Id: 6ed147c0245640dfbcf646a06b47b6ff Apr 20 17:58:37 user devstack@n-api.service[61867]: X-User-Name: tempest-VolumesActionsTest-1269335110-project-member Apr 20 17:58:37 user devstack@n-api.service[61867]: method: > Apr 20 17:58:37 user devstack@n-api.service[61867]: exception: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. Apr 20 17:58:37 user devstack@n-api.service[61867]: action_args: {'id': '436b0a7e-3636-4285-a8cf-48574352b9f3'} Apr 20 17:58:37 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. Apr 20 17:58:37 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 17:58:37 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] Returning 404 to user: Instance 436b0a7e-3636-4285-a8cf-48574352b9f3 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 17:58:37 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-d887ee7d-a3f4-4886-aab7-0f97df954f6b tempest-VolumesActionsTest-1269335110 tempest-VolumesActionsTest-1269335110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3" status: 404 len: 111 microversion: 2.1 time: 0.032266 Apr 20 17:58:37 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 145/432] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 17:58:37 2023] GET /compute/v2.1/servers/436b0a7e-3636-4285-a8cf-48574352b9f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 17:58:38 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:58:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:38 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] Creating event network-changed:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 17:58:38 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-aeab8b96-8c9f-47b2-85fd-5ff0e9ba8dce req-351c18b1-f6ac-4976-a908-5948b7be636b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093246 Apr 20 17:58:38 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 145/433] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:58:40 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "name": "network-vif-plugged", "status": "completed", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:58:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:40 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:40 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] Creating event network-vif-plugged:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 17:58:40 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-ca95b236-3cbb-4c47-97fc-c62ec8bb9fa7 req-0f14d3c2-81cd-44b0-afab-d4afab8d2fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037554 Apr 20 17:58:40 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 144/434] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:58:42 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "name": "network-vif-plugged", "status": "completed", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 17:58:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:58:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:58:42 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:58:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] Creating event network-vif-plugged:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 17:58:42 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-c54652f8-488c-4175-ae20-389c7f4fe964 req-7604de45-5687-40cf-bfff-5d18dfd889bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027585 Apr 20 17:58:42 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 146/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 17:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell0:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:59:25 user devstack@n-api.service[61868]: DEBUG nova.policy [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61868) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 17:59:25 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-b8fbcc06-182f-4413-ad5c-fd46847e6088 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 200 len: 1587 microversion: 2.20 time: 0.238734 Apr 20 17:59:25 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 146/436] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 17:59:25 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 1587 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:00:25 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell0:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:25 user devstack@n-api.service[61866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:00:25 user devstack@n-api.service[61866]: Thu Apr 20 18:00:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/os-interface (ip 10.0.0.210) !!! Apr 20 18:00:25 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:25 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:25 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:00:25 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:26 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:26 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-1196ee31-dce5-4f36-adbd-ee47f13a2f03 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.191370 Apr 20 18:00:26 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 145/437] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 18:00:25 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/os-interface => generated 282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:00:26 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell0:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:26 user devstack@n-api.service[61867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:00:26 user devstack@n-api.service[61867]: Thu Apr 20 18:00:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 18:00:26 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:26 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=4 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:27 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:00:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:27 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:27 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] Creating event network-changed:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 18:00:27 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-68d2bc67-6574-4bc1-a6ff-35bc81606e7a req-ca039538-d23a-4b8e-903d-c8c4ebe71758 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170821 Apr 20 18:00:27 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 147/438] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=2 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:00:28 user devstack@n-api.service[61868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:00:28 user devstack@n-api.service[61868]: Thu Apr 20 18:00:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/ips (ip 10.0.0.210) !!! Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:28 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:28 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-fdb5fe84-7346-40ef-a3da-d5ad315bf795 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/ips" status: 200 len: 150 microversion: 2.20 time: 0.053224 Apr 20 18:00:28 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 147/439] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 18:00:28 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:29 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Going to try to terminate instance {{(pid=61866) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:00:29 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-d7a80ce3-10aa-4313-a0bd-b2870ee0f1d4 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 204 len: 0 microversion: 2.20 time: 0.222946 Apr 20 18:00:29 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 146/440] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:00:29 2023] DELETE /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:29 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "name": "network-vif-unplugged", "status": "completed", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:00:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:29 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:29 user devstack@n-api.service[61867]: DEBUG nova.policy [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '377d01af97a94e36946304d8f4cf2d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5995f15ea45a4b4590b2d181ae5d7907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61867) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:00:29 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-ce12e1fa-bf67-4f96-9824-4c7bda2080ca tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 200 len: 1712 microversion: 2.20 time: 0.232427 Apr 20 18:00:29 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 148/441] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:00:29 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 1712 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:00:29 user devstack@n-api.service[61868]: INFO nova.api.openstack.compute.server_external_events [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] Creating event network-vif-unplugged:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 18:00:29 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [req-c6f9e839-f61d-4c42-a9c1-236ea8f2588f req-31eefe05-5b23-4a03-8ce6-61cf706ddc89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034968 Apr 20 18:00:29 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 148/442] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:00:31 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "name": "network-vif-deleted", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:00:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:31 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:31 user devstack@n-api.service[61866]: INFO nova.api.openstack.compute.server_external_events [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] Creating event network-vif-deleted:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 18:00:31 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [req-3a58fd67-7e22-48d2-ad70-f3eabe164311 req-7405e1c5-a0e5-431e-bc74-64fc75ad7286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039257 Apr 20 18:00:31 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 147/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:00:31 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c133d51-5395-480a-b4df-d34d69bae2eb", "name": "network-vif-plugged", "status": "completed", "tag": "ac4cef98-df9c-489f-8bc9-a35949c3e0d6"}]} {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:00:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:00:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:00:31 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:00:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.compute.server_external_events [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] Creating event network-vif-plugged:ac4cef98-df9c-489f-8bc9-a35949c3e0d6 for instance 8c133d51-5395-480a-b4df-d34d69bae2eb on user Apr 20 18:00:31 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [req-83f40e9c-9597-47d5-aa39-9a2489b0b941 req-4c141300-7a7f-41a1-8fdc-565781388f06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028068 Apr 20 18:00:31 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 149/444] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:01:19 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:19 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=6 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 18:01:20 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb HTTP/1.1 Apr 20 18:01:20 user devstack@n-api.service[61868]: Accept: application/json Apr 20 18:01:20 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 18:01:20 user devstack@n-api.service[61868]: Connection: close Apr 20 18:01:20 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 18:01:20 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 18:01:20 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 18:01:20 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 18:01:20 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:20 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:20 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 18:01:20 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 18:01:20 user devstack@n-api.service[61868]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 18:01:20 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:20 user devstack@n-api.service[61868]: method: > Apr 20 18:01:20 user devstack@n-api.service[61868]: exception: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:20 user devstack@n-api.service[61868]: action_args: {'id': '8c133d51-5395-480a-b4df-d34d69bae2eb'} Apr 20 18:01:20 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:20 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:20 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:01:20 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-6e2f31a3-d08f-4383-b119-486acd263a1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 404 len: 111 microversion: 2.20 time: 0.151543 Apr 20 18:01:20 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 149/445] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:01:19 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:01:20 user devstack@n-api.service[61866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 18:01:20 user devstack@n-api.service[61866]: Thu Apr 20 18:01:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1090953050 (ip 10.0.0.210) !!! Apr 20 18:01:20 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:20 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:20 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-124a9ccb-b014-4200-b861-9641afbe065d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '.version_select at 0x7f342d6b5480>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:20 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-124a9ccb-b014-4200-b861-9641afbe065d tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090953050" status: 204 len: 0 microversion: 2.20 time: 0.047233 Apr 20 18:01:20 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 148/446] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 18:01:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090953050 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:01:20 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_api:SELECT=6 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:20 user devstack@n-api.service[61867]: DEBUG dbcounter [-] [61867] Writing DB stats nova_cell1:SELECT=10 {{(pid=61867) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:20 user devstack@n-api.service[61867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 18:01:20 user devstack@n-api.service[61867]: Thu Apr 20 18:01:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb (ip 10.0.0.210) !!! Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 18:01:21 user devstack@n-api.service[61867]: request: DELETE /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb HTTP/1.1 Apr 20 18:01:21 user devstack@n-api.service[61867]: Accept: application/json Apr 20 18:01:21 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 18:01:21 user devstack@n-api.service[61867]: Connection: close Apr 20 18:01:21 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 18:01:21 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 18:01:21 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 18:01:21 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 18:01:21 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61867]: method: > Apr 20 18:01:21 user devstack@n-api.service[61867]: exception: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: action_args: {'id': '8c133d51-5395-480a-b4df-d34d69bae2eb'} Apr 20 18:01:21 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:01:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-74ea945d-bedd-4ec0-9c9d-c05db6606eee tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 404 len: 111 microversion: 2.20 time: 0.038257 Apr 20 18:01:21 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 150/447] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:01:20 2023] DELETE /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG nova.compute.api [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 8c133d51-5395-480a-b4df-d34d69bae2eb] Fetching instance by UUID {{(pid=61868) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG oslo_concurrency.lockutils [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61868) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61868]: INFO nova.api.openstack.wsgi [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 18:01:21 user devstack@n-api.service[61868]: request: GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb HTTP/1.1 Apr 20 18:01:21 user devstack@n-api.service[61868]: Accept: application/json Apr 20 18:01:21 user devstack@n-api.service[61868]: Accept-Encoding: identity Apr 20 18:01:21 user devstack@n-api.service[61868]: Connection: close Apr 20 18:01:21 user devstack@n-api.service[61868]: Content-Length: 0 Apr 20 18:01:21 user devstack@n-api.service[61868]: Content-Type: application/json Apr 20 18:01:21 user devstack@n-api.service[61868]: Host: 10.0.0.210 Apr 20 18:01:21 user devstack@n-api.service[61868]: Openstack-System-Scope: None Apr 20 18:01:21 user devstack@n-api.service[61868]: User-Agent: python-urllib3/1.26.15 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Domain-Id: None Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Domain-Name: None Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Identity-Status: Confirmed Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Is-Admin-Project: True Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Project-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Project-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Role: reader,member Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Roles: reader,member Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61868]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61868]: X-User-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61868]: X-User-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61868]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 18:01:21 user devstack@n-api.service[61868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61868]: method: > Apr 20 18:01:21 user devstack@n-api.service[61868]: exception: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61868]: action_args: {'id': '8c133d51-5395-480a-b4df-d34d69bae2eb'} Apr 20 18:01:21 user devstack@n-api.service[61868]: {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. Apr 20 18:01:21 user devstack@n-api.service[61868]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 8c133d51-5395-480a-b4df-d34d69bae2eb could not be found. {{(pid=61868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:01:21 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-ab603c42-5587-4f08-ab3b-abd1028e72be tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb" status: 404 len: 111 microversion: 2.20 time: 0.027912 Apr 20 18:01:21 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 150/448] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:01:21 2023] GET /compute/v2.1/servers/8c133d51-5395-480a-b4df-d34d69bae2eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG nova.compute.api [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61866) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG oslo_concurrency.lockutils [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61866) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61866]: INFO nova.api.openstack.wsgi [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 18:01:21 user devstack@n-api.service[61866]: request: DELETE /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 HTTP/1.1 Apr 20 18:01:21 user devstack@n-api.service[61866]: Accept: application/json Apr 20 18:01:21 user devstack@n-api.service[61866]: Accept-Encoding: identity Apr 20 18:01:21 user devstack@n-api.service[61866]: Connection: close Apr 20 18:01:21 user devstack@n-api.service[61866]: Content-Length: 0 Apr 20 18:01:21 user devstack@n-api.service[61866]: Content-Type: application/json Apr 20 18:01:21 user devstack@n-api.service[61866]: Host: 10.0.0.210 Apr 20 18:01:21 user devstack@n-api.service[61866]: Openstack-System-Scope: None Apr 20 18:01:21 user devstack@n-api.service[61866]: User-Agent: python-urllib3/1.26.15 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Domain-Id: None Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Domain-Name: None Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Identity-Status: Confirmed Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Is-Admin-Project: True Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Project-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Project-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Role: reader,member Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Roles: reader,member Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61866]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61866]: X-User-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61866]: X-User-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61866]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 18:01:21 user devstack@n-api.service[61866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61866]: method: > Apr 20 18:01:21 user devstack@n-api.service[61866]: exception: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61866]: action_args: {'id': '20bf3e28-a250-48df-9246-59c132665ba2'} Apr 20 18:01:21 user devstack@n-api.service[61866]: {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61866]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. {{(pid=61866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:01:21 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-890520af-17aa-4d13-adb5-e57f1790ea1e tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 404 len: 111 microversion: 2.20 time: 0.033638 Apr 20 18:01:21 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 149/449] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:01:21 2023] DELETE /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Calling method '>' {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.compute.api [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] [instance: 20bf3e28-a250-48df-9246-59c132665ba2] Fetching instance by UUID {{(pid=61867) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Acquiring lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG oslo_concurrency.lockutils [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Lock "1f878406-f865-4f02-bb10-aa57d0aa28b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61867) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:01:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.wsgi [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] HTTP exception thrown: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Request method failure captured: Apr 20 18:01:21 user devstack@n-api.service[61867]: request: GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 HTTP/1.1 Apr 20 18:01:21 user devstack@n-api.service[61867]: Accept: application/json Apr 20 18:01:21 user devstack@n-api.service[61867]: Accept-Encoding: identity Apr 20 18:01:21 user devstack@n-api.service[61867]: Connection: close Apr 20 18:01:21 user devstack@n-api.service[61867]: Content-Length: 0 Apr 20 18:01:21 user devstack@n-api.service[61867]: Content-Type: application/json Apr 20 18:01:21 user devstack@n-api.service[61867]: Host: 10.0.0.210 Apr 20 18:01:21 user devstack@n-api.service[61867]: Openstack-System-Scope: None Apr 20 18:01:21 user devstack@n-api.service[61867]: User-Agent: python-urllib3/1.26.15 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Auth-Token: gAAAAABkQXyiDUhdG27zKcdVLS6mzJbQ3gOOKw7H-w0oYNBYJmbx5C6DAKwA_mEPqi_udh5uRQynN_6kPgqhls80LdZfeXEr0bsUSTAJKTEJ9Ba18NYheOBTQg82syfL31JYjKtYdlXjTwk__lKNbNIPF9Rk7AcTjqNw5xVCyvDPEYbnQXog5oI Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Domain-Id: None Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Domain-Name: None Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Identity-Status: Confirmed Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Is-Admin-Project: True Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Role: reader,member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Roles: reader,member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5995f15ea45a4b4590b2d181ae5d7907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant-Id: 5995f15ea45a4b4590b2d181ae5d7907 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1882994267 Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Domain-Id: default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Domain-Name: Default Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Id: 377d01af97a94e36946304d8f4cf2d7c Apr 20 18:01:21 user devstack@n-api.service[61867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1882994267-project-member Apr 20 18:01:21 user devstack@n-api.service[61867]: method: > Apr 20 18:01:21 user devstack@n-api.service[61867]: exception: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: action_args: {'id': '20bf3e28-a250-48df-9246-59c132665ba2'} Apr 20 18:01:21 user devstack@n-api.service[61867]: {{(pid=61867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. Apr 20 18:01:21 user devstack@n-api.service[61867]: ERROR nova.api.openstack.wsgi Apr 20 18:01:21 user devstack@n-api.service[61867]: DEBUG nova.api.openstack.wsgi [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] Returning 404 to user: Instance 20bf3e28-a250-48df-9246-59c132665ba2 could not be found. {{(pid=61867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:01:21 user devstack@n-api.service[61867]: INFO nova.api.openstack.requestlog [None req-b3092963-0f3c-462b-b3af-2afeb9a5fda7 tempest-AttachVolumeShelveTestJSON-1882994267 tempest-AttachVolumeShelveTestJSON-1882994267-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2" status: 404 len: 111 microversion: 2.20 time: 0.031628 Apr 20 18:01:21 user devstack@n-api.service[61867]: [pid: 61867|app: 0|req: 151/450] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:01:21 2023] GET /compute/v2.1/servers/20bf3e28-a250-48df-9246-59c132665ba2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:01:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_api:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:51 user devstack@n-api.service[61868]: DEBUG dbcounter [-] [61868] Writing DB stats nova_cell1:SELECT=4 {{(pid=61868) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:51 user devstack@n-api.service[61868]: DEBUG nova.api.openstack.wsgi [None req-576d1a7d-6254-4d10-89c7-5d397c3d855e tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] Action: 'create', calling method: .version_select at 0x7f342d77d7e0>, body: {"keypair": {"name": "tempest-TestStampPattern-373599258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJACJp20h4xxzB7ZQnP/gI8GPlgIYd9i2REI7a1ECCcO/0c3imlUZcCFyx3vp0/Nxozjm5vPRH16Bq+9QCidyfCQ4I9RDDnkesBufFJwMDLsVcuamPd+DhgpM0ZL2u2fxg=="}} {{(pid=61868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:01:51 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-576d1a7d-6254-4d10-89c7-5d397c3d855e tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] Getting quotas for project 01ce967cbf7c4d70bb0307d6217e6a5e. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:01:51 user devstack@n-api.service[61868]: DEBUG nova.quota [None req-576d1a7d-6254-4d10-89c7-5d397c3d855e tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] Getting quotas for user 412819239a6e484eb230cc3aae0b91b3 and project 01ce967cbf7c4d70bb0307d6217e6a5e. Resources: {'key_pairs'} {{(pid=61868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:01:51 user devstack@n-api.service[61868]: INFO nova.api.openstack.requestlog [None req-576d1a7d-6254-4d10-89c7-5d397c3d855e tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.296460 Apr 20 18:01:51 user devstack@n-api.service[61868]: [pid: 61868|app: 0|req: 151/451] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:01:51 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:01:54 user devstack@n-api.service[61866]: DEBUG nova.api.openstack.wsgi [None req-bf49b23f-6a66-4435-825b-5c15a555b5d8 tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] Calling method '.version_select at 0x7f342d6b4e50>' {{(pid=61866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:01:54 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:54 user devstack@n-api.service[61866]: DEBUG dbcounter [-] [61866] Writing DB stats nova_cell1:SELECT=2 {{(pid=61866) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:01:54 user devstack@n-api.service[61866]: INFO nova.api.openstack.requestlog [None req-bf49b23f-6a66-4435-825b-5c15a555b5d8 tempest-TestStampPattern-806162736 tempest-TestStampPattern-806162736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-373599258" status: 202 len: 0 microversion: 2.1 time: 0.026323 Apr 20 18:01:54 user devstack@n-api.service[61866]: [pid: 61866|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:01:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-373599258 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)